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Preface 


With the rapid development of science and technology, networks play an important 
role in control systems. Typically, in a control system, the plant and the controller 
may communicate via a network. Such systems are called networked control systems 
and they have received significant attention in the literature. The introduction of a 
network has many advantages such as low cost, easy installation, and maintenance. 
However, a network also introduces some imperfections such as varying sampling, 
transmission delays, transmission protocols, packet losses, and so on. Besides, the 
network may also suffer from network attacks such as Denial of Service attacks. 
These imperfections may degrade the system performance and even make the closed- 
loop systems unstable. Therefore, it is necessary to investigate the effect of these 
imperfections on the stability and performance of control systems in a quantitative 
manner. 

The content of this book consists of two parts. The first part aims at proposing 
modeling and analyzing approaches for network-based control systems under 
different problem settings. Model-based event-triggered transmission strategies are 
proposed to reduce the data transmissions in the network. We also consider the 
stability problem for networked control systems in the presence of stochastic noise 
and stochastic detecting instants. For all of these cases, hybrid models are estab- 
lished and Lyapunov functions are constructed. The second part first investigates 
the distributed unconstrained optimization problem which is solved over a network 
communication topology. The network may be destroyed by persistent attackers 
that result in communication failures. A distributed switching algorithm is proposed 
and a hybrid model is established to analyze stability. Then, the proposed method 
is extended to constrained aggregative games which are subject to unknown time- 
varying disturbances and unmodeled terms, and the communication topology is also 
influenced by attacks. This book provides a unifying framework to understand the 
complex dynamics of network-based control systems. The content is appropriate 
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for students, control engineers, and scientists who are interested in network-based 
control and optimization problems. 
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Notations 


n-dimensional Euclidean space 
2-norm of a matrix 

unit ball 

ball with radius r 

inner product of two vectors 
transpose of vector x 

(x7, 7)" 

set of integers 

[0, oo) 

(—oo, 0] 

set of non-negative integers 
set of non-positive integers 


(0, oo) 

set of positive integers 
{@ xw" |x; € Rao] 
[0s ow" i € Z2] 


distance of a point x to a set YW 

n-dimensional zero matrix 

n-dimensional identity matrix 

Zero vector with appropriate dimension 
n-dimensional vector with all elements being 1 
block diagonal matrix 

maximal eigenvalue of a positive definite matrix 
minimal eigenvalue of a positive definite matrix 
Kronecker product of matrices A and B 

closed convex hull of a set 

closure of a set 

{yly=x+z,z€ 2} 

tyly=x-z,.2€ 2} 

interior of a set 92 
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Notations 


lx : |xlg x £} 
Ix : |xls < £} 


(Gn. Jl e 8] 
sgn(x) = 1, for x > 0,0, for x = 0 and —1 for x < 0 


(sgnQa), sgnQa), -- - , sgnQu))" 


SGN (x)= 1, for x>0,[-—1, 1], for x a0 and —1 for x < 0 
)) SGN EH), SEN G3), = SGN s)" 


Chapter 1 A) 
Introduction E 


1.1 Network-Based Control 


Networked control systems refer to control systems in which the plant and the con- 
troller communicate via a network channel. Introduction of the network brings some 
benefits such as low cost, easy installation and maintenance. On the other hand, the 
network also introduces some imperfections such as varying transmission intervals, 
varying transmission delays, communication constraints, quantization effects and 
packet losses. The network may also suffer from various kinds of attacks such as 
denial-of-service attacks which can block the transmission channels. Therefore, it 
is necessary to investigate the effects of various kinds of imperfections on stabil- 
ity and performance of the closed-loop systems in a quantitative manner. Besides, 
in networked control systems, another important problem is how to reduce the data 
transmissions because the network resources are limited. There are mainly two trans- 
mission strategies. One is the time-triggered transmission strategy, which triggers the 
data transmission periodically, and the other is the event-triggered transmission strat- 
egy, which triggers the data transmission based on a triggering condition involving 
the system state and error variable. The latter has the potential to reduce data trans- 
missions because a transmission happens only when it is necessary. 

In networked control systems, there are mainly two modeling approaches. One is 
the delay system approach, which models the sampled-data control system into an 
input delay system and then the Lyapunov functional approach is applied to analyze 
the stability and performance of the resulted closed-loop system. The delay system 
approach has the advantage of less conservativeness but is often restricted to linear 
systems. The other modeling approach is the hybrid system approach, which models 
the networked control system as a hybrid system. The hybrid system approach is more 
appropriate for nonlinear systems and is flexible enough to model various kinds of 
complex dynamical systems such as event-triggered control systems. 
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2 1 Introduction 


Fig. 1.1 Structure of Sampler 
networked control systems 


Plant 


Controller 


Figure 1.1 illustrates a simple structure of networked control systems. The dynam- 
ics of the plant can be described by the following differential equation 


t= f(x,u). (1.1) 


A network-based controller can be used to stabilize the plant and its mathematical 
form is given as follows 


u(t) = k(x(ti) t € [ti ti41). (4.2) 


where f; is a sequence of transmission instants. Define an error variable e(t) :— 
x(t;) — x(t), t € [t;, t:41). Then the error variable e will have jump dynamics at the 
transmission instants. Specifically, once a transmission happens and the controller 
has received the transmitted data, e will be reset as zero. Therefore, e has continuous 
dynamics and discrete jump dynamics. Specifically, the continuous dynamics of x 
and e can be described by the following differential equation 


i = f(x, ka t e) 
é = —f(x,k(x + e)). 


The discrete dynamics of x and e can be described by the following difference 
equation 


xt =x 


e* = 0. 


Actually, real networked control systems are very complex due to the effect of 
various kinds of network factors. The transmitted data can arrive at the destination 
only after some time of delay. Networked control systems may contain many nodes 
and the sensors in each node collect part of the system data. Due to the limitation 
of communication bandwidth, only part of the sampled data can be transmitted via 
the network to the destination. Transmission protocols are therefore introduced to 
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Fig. 1.2. Structure of Node 1 
networked control systems 
with multiple nodes 


Node 2 


Node "| 
eat) 


Controller |- 


schedule the transmission order of the data in different nodes. The most widely known 
transmission protocols are the Round-Robin protocol, Try-Once-Discard protocol 
and stochastic protocols. For the Round Robin protocol, each node is authorized 
to have access to the network periodically. For the Try-Once-Discard protocol, all 
the nodes compete with each other and the node with the maximal error weight 
has the access to the network. For the stochastic transmission protocols, the nodes 
are authorized by stochastic scheduling rules. Figure 1.2 illustrates the structure of 
networked control systems containing multiple nodes. We will use the hybrid system 
framework to model networked control systems under different problem settings and 
provide corresponding analyzing approaches. 


1.2 Basic Knowledge About Hybrid Systems 


A hybrid dynamical system refers to dynamical systems that exhibit continuous- 
time dynamics and discrete-time dynamics [22, 31, 44, 76]. In this book, we use the 
hybrid framework proposed in [22] for our considered problems. 


1.2.1 Hybrid Dynamical Systems 


We introduce some basic knowledge about hybrid dynamical systems [22] charac- 
terized by 


xeF(x),xecCc 


1.3 
xt €G(x), x ED, el 


where C C R” is the flow set, D C R” is the jump set, the set-valued mapping 
F : R” = R” is the flow map and the set-valued mapping G : IR" = R” is the jump 
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map. System (1.3) is represented by the notation # :— (C, F, D, G}, where C, F, D 
and G comprise the data of .#. A subset E C Rso x Z«o is a compact hybrid time 
domain if E — Urzo(s;. Sj+1], J) for some finite sequence of times 0 = sọ < s; < 
S2 < ...5j.Itisa hybrid time domainifforall (T, J) € E, E N ([0, T] x (0,1,..., JÐ 
is a compact hybrid domain. 


Definition 1.1 [22] A function x : dom x > IR" is a hybrid arc if dom x is a hybrid 
time domain and t — x(t, j) is locally absolutely continuous for each j such that 
the interval 7; :— {t : (t, j) € dom x} has nonempty interior. A hybrid arc is com- 
plete if its domain is unbounded. A hybrid arc x is a solution to system (1.3) if 
x(0,0) € CU D, and the following two conditions hold: 


(1) for all j € Z>o such that /; has nonempty interior 


x(t, j) eC for all t € int(1j), 
x(t, j) € F(x(t, j)) for almost all t € Ij; 


(2) for all (t, j) € dom x such that (t, j + 1) € dom x, 


x(t, j) €D, 
x(t, j+ 1) e G(x(t, j)). 


The following two definitions characterize two special classes of functions that 
will be often used. 


Definition 1.2 A function o : R>ọ — Rs» is said to be a class-/£ function if it 
is continuous, zero at zero and strictly increasing. œ : R>ọ — Rso is a class-/fo; 
function if it is a class-/£/ function and unbounded. It is a class-Y,, function, if it is 
continuous, nondecreasing and unbounded. 


Definition 1.3 A function B : R>ọ x Rso — Rzoissaidtobeaclass X -Z function 
if itis nondecreasing in its first argument, nonincreasing in its second argument, and 
lim;.,o- (s, t) = lim, (s, t) = 0. 


The following definition characterizes a class of set-valued mappings owning 
some continuity properties. 


Definition 1.4 A set-valued mapping M : IR" = R” is outer semi-continuous (OSC) 
atx € R” if for all sequences x; — x and y; € M(x;) such that y; — y we have that 
y € M(x). A set-valued mapping M : IR" = R” is locally bounded (LB) at x € IR" 
if there exists a neighborhood U, of x such that M(U,) C R” is bounded. Given a 
set (2 C R", the mapping M is said to be OSC and LB relative to £2 if the set-valued 
mapping from R” to R” defined by M (x) for x € 2 and Ø for x ¢ 2 is OSC and 
LB at each x € 92. 


We next give stability definitions for hybrid systems. 


Definition 1.5 [22] Consider a hybrid system # on IR". Let W C IR" be closed. 
The set Y is said to be 
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e uniformly asymptotically stable if there exist a class-/£/ .Z? function f and a pos- 
itive constant c, such that for any solution x to # with |x(0, Oly < c, 


Ix, Div < BUxO, Oly, t+ j), Yt, j) € dom x; (1.4) 


e uniformly globally asymptotically stable if inequality (1.4) is satisfied for any 
solution to #. 


1.2.2 Stochastic Hybrid Systems 


Consider the following stochastic hybrid systems proposed in [83] 


dx = F(x)dt + B(x)dw (1.5) 
= G(x, v) 

where x € R” is the state variable and w is a brownian motion. C C R” and D C R” 
are respectively the flow set and jump set. (F, B) and G are respectively the flow 
map and jump map. v is a placeholder for independent, identically distributed (1.1.d.) 
random variables. F and B are continuous functions. x +> G(x, v) is a continuous 
function foreach v € R?. Let (2, F , P) be a given probability space. Let (v;];*, with 
: Q? > R^ be the sequence of i.i.d. random variables, defined on this probability 
space. Let Êo = = (£2, Ø}, and let Cg 2 denote the minimal filtration associated to 
the random process {v,}P2,; that is, F; is the o-algebra generated by (vi, =; Vi). 
Define F := (£5 heza: The additional filtration F :— Am of (2, F, P) is 

independent of F and is such that Zo contains all P- -negligible subsets in F. 


Definition 1.6 [83] Given the filtered probability space (2, F , IF, P), an F-adapted 
Brownian motion relative to this space is a continuous process w = (w(t, -)};>0 with 
the properties that o (w(s, -)), s € [0, t] C F, forallt > 0, w(0, -) = 0 almost surely 
and for 0 < s < t the increment w(t, -) — w(s, -) is normally distributed with mean 
zero and variance t — s and is independent of F. 


Define the hybrid filtration [83] 


= (Jo (Fre, Y RoxZ0: (1.6) 
e>0 


Definition 1.7 [83] A relaxed hybrid arc is a mapping $ : H — R” such that H isa 
hybrid time domain and, for each j € Z«o, t > (t, j) is continuous. A stochastic 
hybrid arc is a mapping x defined on «2 such that x(w) is a relaxed hybrid arc for 
each w € €2 and the set-valued mapping from 2 to R"*? defined by 
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w +> graph(x(o)) := ((t, j, z) € R"? : (t, j) € domx,, z 2x,(t. j)) 


is F -measurable with closed values. An F-adapted stochastic hybrid arc is a stochas- 
tic hybrid arc x such that the set-valued mapping 


@ e graph(x(o)) n ([0, t] x {0,--- , j} x R”) 


is F, ;-measurable for each (t, j) € Roo x Zo. 


Definition 1.8 [83] Given the sequence of i.i.d. random variables v :— (vi)];2,, a 
solution starting at x € IR" is a pair (x, w), where 


e x is an F-adapted stochastic hybrid arc, 
e wis an F-adapted Brownian motion 


such that x(@) is a solution starting at x with the inputs w(-, œ), v(@) for every o. 
That is, for almost every w € Q, 


e x,(0,0) = x; 
e for each j € Zso, if IH (o) := (t : (t, j) € x(@)} has nonempty interior then, for 
every t € I/ (o), 
(a) x, (t, J) € € 
(b) x (t, j) — xo (Tj, j) = fr, Fds + fy, Bdw(s, w) 
e if (r, j), (t, j-- D) e domx(o) ten. ` 
(a) x, (t, j) € D 
(b) x, (t, j + D) = Galt, j), Vj4+1(@)). 


For a solution (x, w) starting at a point in K, we use the shorthand notation x € 
AK). 
Nexttwo important stability concepts are introduced for stochastic hybrid systems. 


Definition 1.9 [83] A compact set . is said to be 


e uniformly Lyapunov stable in probability if for each € > 0 and p > 0 there exists 
ô > O such that 


x € V. of + 8B) > P(graph(x) C R2 x (Y +B) > 1— p, (1.7) 


e uniformly Lagrange stable in probability if for each ê > 0 and p > 0 there exists 
€ > 0 such that (1.7) holds, 

e uniformly globally stable in probability if it is both uniformly Lyapunov stable in 
probability and uniformly Lagrange stable in probability, 

e uniformly globally attractive in probability if for each A > 0, € > 0 and p > 0 
there exists r > 0 such that 
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x € P(A + AB) > P(graph(x) N (T>, x R”) c R? x (% +e 


where IS, :— ((s,i) : (s,i) € R2, s+i>t}, 


Sely 


e uniformly globally asymptotically stable in probability (UGASp) if it is uniformly 
globally stable in probability and uniformly globally attractive in probability. 


Part I 
Modeling and Stability Analysis 
for Networked Control Systems 


Chapter 2 A) 
Model-Based Event-Triggered Control geit 
for Distributed Networked Control 

Systems 


2.1 Introduction 


Event-triggered sampled-data control has received a lot of attention in recent years 
due to its potential advantage over time-triggered sampled-data control, namely that 
it may reduce the data transmission in the network [12, 19, 21, 40, 51, 54, 66, 73, 
80, 87, 96, 104, 106, 107, 111]. Most of existing literature on event-triggered trans- 
mission strategies use zero-order-hold between two updating times on the controller 
side once the feedback data is received (see, for example, [80, 107] and references 
cited therein). The zero-order-hold has the advantage to be implemented easily in 
sampled-data control systems while it may result in large error between plant state 
and data kept by the zero-order-hold at the controller side. Differently, model-based 
sampled-data control sufficiently utilizes the model information at the controller 
side and, between two updating times, the controller predicts the plant state based on 
the models and received feedback data. With the model-based controller, less data 
transmission may be expected by the controller designers [27, 59, 105]. Considering 
model-based control and event-triggered sampled-data control at the same time is 
thus an appealing research topic. 

The author in [80] proposes an event-triggered scheduling rule based on an 
inequality relation involving the plant state and state kept by zero-order-hold at the 
controller side, and proves that Zeno behavior will not happen under the designed 
transmission condition. Different from [80], the author in [21] proposes a dynamic 
event-triggered transmission strategy which needs to detect whether the state value of 
an auxiliary integrator with positive initial state arrives at zero. Guaranteeing asymp- 
totic stability, the authors in [2, 73] consider the event-triggered control for systems 
with output feedback and impose a waiting time between two transmission times 
to avoid Zeno behavior. In [13], the authors consider small delays and transmission 
protocols in each local network for interconnected nonlinear systems with output 
feedback, and propose static and dynamic event-triggered transmission strategy by 
imposing a waiting time in each local network. 
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The previously mentioned literature uses a zero-order-hold at the controller side 
which maintains the received feedback data between two updating times. In [18, 
27], the authors consider the model-based event-triggered transmission strategy. The 
authors in [18] consider transmission delays and quantization effects in the net- 
work for uncertain linear systems and the proposed transmission strategy is static. 
Zeno behavior is precluded by proving that there is a lower bound between the 
inter-execution times. The authors in [27] consider linear discrete-time systems with 
disturbances and propose a periodic event-triggered transmission strategy. Moreover, 
for decentralized linear systems, the authors in [27] use a reduced model of each sub- 
system to predict the subsystem state for the packet dropout situation. Differently, this 
chapter aims at designing centralized and distributed model-based dynamic event- 
triggered transmission strategies. The literature closest to our work is [13, 18, 27]; 
while [18] considers static and centralized event-triggered transmission strategies, 
[27] considers discrete-time systems without delays and protocols and [13] uses a 
zero-order-hold. 

The main content of this chapter can be summarized as follows. A model-based 
dynamic event-triggered transmission strategy is proposed for uncertain sampled- 
data linear systems with transmission delays and protocols in the network. By intro- 
ducing storage variables, the entire systems are modeled as hybrid systems and then 
based on stability theorems of hybrid systems, the explicit parameters of dynamic 
equation involving the transmission strategy are designed such that the hybrid sys- 
tems are asymptotically stable. Moreover, for uncertain linear systems that can be 
decomposed into interconnected subsystems, a distributed model-based dynamic 
event-triggered transmission strategy is also proposed. In each local network, the 
local controller runs a reduced model that does not use information about other sub- 
systems. Again based on a hybrid system model, the parameter design is explicitly 
presented and asymptotic stability is guaranteed. 


2.2 Model Description 


Consider the following plant 
X = Ax(t) + Bu(t) (2.1) 


where x € R™ is the state, and u € IR” is the control input. The following model- 
based controller is used to stabilize system (2.1): 


& = AR(t) + Bu(t) 
u(t) = KX(t) (2.2) 


where x € IR": is the state of the model, A and B are the ideal parameters of system 
matrices. We will denote Ag := A+ BK, Bo :— BK, AAo:— A-- BK —A— BK 
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and AB, := BK — BK for brevity. We consider the case that the state of system 
(2.1) is sampled by the sensors and transmitted via the network at times f; > 0,i € 
Z>o to the controller. It is assumed that there are £ nodes in the network and the 
state x is separated into x = (x1, X2, ..., X¢) correspondingly with x; € R^". At 
each transmission time f;, only one node j(t;) € (1, 2, ..., £} is authorized by the 
transmission protocols to transmit the data x ;(; to the controller. 

The transmitted data x;(t;), j € (1,2, ..., £} will arrive at the controller at t; + 
di, d; > Oaftercertain transmission delay d; < t;,, — t;. Once the controller receives 
the transmitted data at t; + d;, X will update based on the following equation 


R(t + di)*) = e^t (hh, — PODEC) + eG)x(;) (2.3) 
where c (7) is a block diagonal matrix defined as 


(i) := diag (O,,, se bg On, i In, ,0 Lys 0,,,,) 


1 Map” 


and j in (i) means that the node j is authorized by the transmission protocol at 
time f;. 

Update of x at t; + d; based on (2.3) can be realized through the time stamp tech- 
nique in the network. Once the controller receives a packet including the information 
x; (t;) and corresponding time stamp, the controller will compute the transmission 
delay d; and X((t; + d;)*) by combining the past information 4(f;) stored in the 
memory of the controller. The reason that € updates in the form (2.3) is that the 
sensors also run a model that is same as that in the controller 


EI 
ll 
> 


ox, t € [ti, tiy] 
which updates at t; according to 
X(t") = Un, — ODI) + D(x Cti). 


Under the same initial condition X (fo) = X(to), the updating Eq. (2.3) will ensure 
£((t; + di) *) = x((t; + d;)*) and thus X(t) = x(t), t € (t; + di, tj41] whichis used 
to ensure stability of closed-loop system if we realize that the transmission protocols, 
for example, Try-Once-Discard protocols [64] and the event-triggered transmission 
strategy introduced below can access only the plant state and model state in the 
sensors. The updating Eq. (2.3) can also be found in [18], which considers only one 
node in the network. 
Denote e := x — x € R” with n, = n,. Then from (2.3), we have 


(t + di)*) = e^ (hG, e(t;)) + x (t;)) (2.4) 


where for brevity, we denote h(i, e) := (In, — ®(i))e and call A (i, e) the transmis- 
sion protocol. 
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From (2.4), it can be seen that the jumping dynamics at t; + d; depend on the past 
state. Therefore, we introduce a storage variable $ which has continuous dynamics 


Aos(t), t € [t;, ti 4- di] 


S= (2.5) 
X, t € [ti + di, tii] 
and discrete jump dynamics 
SF) = hhi e(t)) +x), (t +di)™) = x(ti + di). (2.6) 


From (2.4), (2.5) and (2.6), we can see that 
E(t, + di)*) = $ (t; + di) 
= e^ (h(i, e(t;)) + x(t). 


Replace variable $ with $ = s + x. Then s will be subject to the continuous dynamics 


. Aos(t) — AAox — BKe, t € [ti, t; + di] 
i= (2.7) 
0, t € [t - dj, ti+4] 


and discrete jump dynamics as follows 
s(t") — h(i, e(t)), s(t + di)*) — 0. (2.8) 
As a result, the jump dynamics of e can be represented as 


e((t; + di)*) = ê (Cti + di)*) — x(t) + di) 
= $(t; + di) — x (ti + di) 
= s(t; + dj). (2.9) 


The sampling sequence {t;}?°) is assumed to be generated by the following event- 
triggered transmission strategy 


tiga = inf(t]t > ti + T, v(t) <0} (2.10) 


where T > 0 is a waiting time used to avoid the Zeno behavior and v is subject to 
the following dynamic equation which will be designed with initial value v(to) > 0: 


2o [feo x) te li +T) 


= (2.11) 
Sov, x(t), e(t)), t E [t; + T, fi, 1]. 
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The transmission strategy (2.10) is a dynamic event-triggered transmission strategy 
since its triggering condition depends on the solution of the dynamic equation. The 
following assumptions are used. 


Assumption 2.1 The transmission delays d; satisfy 0 < d; < t* < T. 


Assumption 2.2 5,4, > 0 and ôg, > 0 are such that the model uncertainties satisfy 
|AAo| < ôa, and |ABo| < ôg- 


Assumption 2.3 [29] The transmission protocol h(x, e) is uniformly globally expo- 
nentially stable (UGES) which means that there exist a continuous function W : 
Zs x R'" — R which is locally Lipschitz continuous in its second variable, con- 
stants a; > OG = 1, 2) and A € (0, 1) such that for all x € Z>ọ and e € R”, the 
following conditions hold: 


ale| < Wk, e) x ale| 
W(k -- 1, h(k, e)) < XW(k, e). 


Moreover, there exist constants M > 0, Aw > 1 such that for all « € Zs and almost 
all e € R”, it holds that 


one 3| <M 
de E 


and for all k € Zs and all e € R”, we have such that 


Wk --1,e) x AwWY(x, e). 


Combining (2.1), (2.2), (2.7), (2.8), (2.9), (2.10) and (2.11), we can model the 
resulting networked control systems into a hybrid system [22] with flow dynamics 
consisting of three subsystems in three subsets of the flow set 


z= f(z), ze€C 


(2.12) 

zt —g(2,zeD 
where z := (x, e, s, v, l, t, K) is the state variable, C :— C1 U C2 U C3, D := D, U 
D» U D3 which are specified in the following description. The flow dynamics are 
governed by 
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x = fix, e) 
e = fr(x, e) 
S = f(x, e, s) 
zEC v= fy(x,e,v) "T 
i-0 
t=1 
k=0 
where 
file, e) = (Ao + AAo)x + (Bo + ABo)e 
falx, e) := — AAox + (A — ABoe 
Aos — AAox — BKe, zeci 
fax, e, s) = 
: ze C2 U C3 
v , 5 € C UC 
fox, e, v) = fu.o(v, x) pie 
furl, x, e), oC, 
and 


C, := R™ x R” x R" x Ryo x (1) x [0, t*] x Zzo, 
C; := R™ x R”? x {0} x Rzo x (0) x [0, T] x Zso, 
C3 := R™ x R” x {0} x Rzo x {2} x [T, oo) x Zzo. 


t is a timer variable, « is a counter variable that keeps track of the sampling times 
and / is a logic variable used to identify whether a transmitted data arrives at the 
controller. 

The jump dynamics are subject to the following equations 


G(x, e, S, v, l, t, K)-— (x, s, 0, vU, 0, T, K), ZE Di 
G(x,e, s, V, l, t, k) = (x, 6,5, U, 2, t, Kk), z € D2 
G(x,e,s,u,l,Tt,K) = (x,e, h(k,e),v,0,0,k + 1), z € Di (2.14) 


where 


D, := R™ x R” x R" x Ryo x (1) x [0, t*] x Z>0, 
D2 := R™ x R™ x {0} x Rzo x {0} x {T} x Zzo 
D3 := R” x R” x {0} x (0) x {2} x [T, 00) x Zzo. 


The flow dynamics (2.13) characterize the situation that the sampled data still does 
not arrive at the controller and also characterize the situation that the sampled data 
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already arrives at the controller while the value of the timer stills does not exceed the 
waiting time. Moreover, the flow dynamics (2.13) also characterize the case that the 
value of the timer exceeds the waiting time while the transmission condition is still 
not satisfied. Introducing a storage variable s in the model is inspired by the paper 
[29], which considers the zero-order-hold case while we consider a model-based 
controller. In [29], the storage variable is subject to 5 — O in the flow set. 

From (2.10), the transmission is triggered immediately once v arrives at zero, 
while from the flow set in systems (2.12), a solution of systems (2.12) may still 
evolve continuously when v arrives at zero. The hybrid systems (2.12) can generate 
a set of solutions which is larger than that generated by (2.10). Therefore, stability 
of the closed-loop networked control systems under event-triggered transmission 
strategy (2.10) can be deduced by stability of hybrid systems (2.12). 


2.3 Design of Triggering Function and Stability Analysis 


In Sect. 2.2, we modeled the event-triggered control systems as a hybrid system. In 
this section, we will give explicit designs of the triggering conditions such that the 
closed-loop systems are stable. 

Define the following functions W; : Zzo x IR": x R> — Rso: 


Wolk, €, s) = Wk, e) 


Wi(k, e, s) : = max(W (x, s), Zwe, e)}, 
w 


W2(k, e, 5): = W(k,e) 


where W satisfies the conditions in Assumption 2.3. From the definitions of 
Wo, Wi, Wo, it is clear to see that there exist bj}, bj; > O such that bj;|(e, s)|? < 
Wk, e, s) € bp|(e, s)? for all z € C U D with z specified below (2.12) by com- 
bining Assumption 2.3 and triangle inequality of vector norm. These two functions 
will be used as the energy functions of (e, s) subsystems in different subsets. 

Using Assumption 2.3, we can conclude the following lemma 


Lemma 2.1 Suppose Assumption 2.3 holds. Then for all k € Zzo, x € R™ and 
almost all e € R", s € R", it holds that 


jme e, s) 


3 (hx, e), fa(x, e, 5))) < LIWi + Hi(x) 
(e, s) 


M(\A|+6 
where Ly = L5 :— a 


Hi (x) := Mês, |x|, and 


M(\A| + ôB)  MIAolA + ee 


Lı := max | 
a1 air 
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We are ready to present one of the main conditions in this chapter before the main 
result is presented. 


Condition 2.1 There exist constants a, a2 > 0, positive definite functions $,  : 
R” — Rso and x : R"e — Rzo, constants ô > 0, yı > 0, yo = yo > 0, and a con- 
tinuously differentiable function V : R= — R such that the following conditions 
hold 

(C1) ay|x|? < V(x) € aty|x|? for all x € R”, 

(C2) for all z € C 


aV 2 2 2y2 
3; ^ x —6|(x, e, s) — 6 (x) — Hi (x) + ye Wi (k, e, 5), 
(C3) for all k € Zzo, x € R™ and e € R”, 


Ho (x) + x (e) + 6G) = yé W? (c, e) + 2XyoW (k, e) LoW Qc, e) + Ho(x)) + g(x). 


Remark 2.1 (C1) of Condition 2.1 is trivial. (C2) are essentially input-to-state sta- 
bility conditions. Roughly speaking, (C2) means that different gains are assigned to 
subsystems of (e, s). Since the system is linear, the continuously differentiable func- 
tion V is actually chosen as V (x) := x’ Px. If Ao is Hurwitz and the uncertainties 
are small then Condition 2.1 can always be satisfied with appropriate parameters. 


In hybrid systems (2.12), the parameters T and t* are also needed to be designed. 
To solve for these two parameters, consider the following two ordinary differential 
equations firstly motivated by [29] 


To = 2Lg7to yore yo 
y2 

wy -—2Lym — yonr? — + (2.15) 
Yo 


where yo, y; > 0. With the above equations, the parameters T and t* are generated 
by the following conditions. 


Condition 2.2 For A € (0, 1), the pair (t*, T) withO < t* < T satisfies the follow- 


ing conditions 


1 
m0) = 5. mo(0) € (A, 1], 


mo(T) — A, mo(0) x mi (0), VO € [O, t*] (2.16) 


>= 


where my, 7t, denote solutions of systems (2.15). 


Since any solution of the second equation in (2.15) with positive initial value will 
be decreasing and the righthand side has the negative constant term, we can always 
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find a number T > 0 such that zo (T) = à with z9(0) € (A, 1]. Then we can also 
find a number t* < T such that xı (0) > z9(0), V0 € [0, t*]. 
We are ready to present one of the main results in this chapter. 


Theorem 2.1 Consider systems (2.12) and suppose Assumption 2.3 holds. Assume 
Condition 2.1, 2.2 hold. Suppose that the functions in transmission strategy (2.10) 
are designed as follows 


fv,o(u, x) : = —po(v) + 6 (x) 
fo (v, x, e) : = —pi(v) + (x) — x (e) 


where po, p; are arbitrarily class-X functions, then the set Y = {0} x (0) x {0} x 
{0} x (0, 1, 2} x Rzo x Zzo will be UGAS for systems (2.12). 


Proof of Theorem 2.1 Let 7t; = mp and Tı = Pn. Then Eq. (2.15) can be trans- 
formed into the following form 


2Lofto — oñ — yo 
Tı = —2Lji — yt? — yi. (2.17) 


E 
© 
| 


The conditions (2.16) can be transformed into the following forms 


AO =Z, x0 € 0. =I 
T =—-, 7 _ 
1 A 0 x 
ToT) 2A, — yif (0) = yosto(0), VO € [0, c7]. (2.18) 
Choose the following function 


V (x) + yt ()W?(k, e, s) tv, z€ Ci UCU DIU Do 


U (z) :— " 
V (x) - AyoW; (k, e, s) 9- v, z € C3 U D3 


where ñ; are the solutions of (2.17) satisfying (2.18). The function U is locally 
Lipschitz continuous on CU DU g(D) and there exist @,@2 € # such that 
&ı(lzly) < U (z) < @(|z|y ) for all z € C U D. For almost all z € C4, it holds that 
oV Ax 2 ~ 
(VU(z), f) < gx + yi Wi (e, e, s) + 2Liyyii Wi (K, e, s) 
c 2yitiWi(k, e, S) Hi(x) + ù. (2.19) 
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Using (C2) of Condition 2.1 and substituting f and ù into (2.19), we can obtain 


(VU(z), f) < —8|(x, e, 8)? — p(x) — H? Œ) + y? Wi, e, s) 
— yp ite W? (k, e,s)— Y2W2(k, €, 5) 
+ 29 fà Wi (K, e, 8) Hi(x) — po(v) + $(x) 
< —8|(x, e, s)? — pov). 


Similarly, for almost all z € Co, (VU (z), f) < —ó|(x,e, DIE — po(v). For almost 
all z € C3, it holds by combining (C2) and (C3) of Condition 2.1 that 


(VU (2), f) < —8IG, e, S)? — pi(v). 


Since oo, p, are class-.% functions, there exists a positive definite function œ such 
that for almost all z € C, we have 


Ù < —a(U). 
For z € Dy, it holds that 


U (g(z)) = V (x) + yorto(t) Wo (k, e, s) 
< V(x) + ya (t) WP (K, e, s) 
= U (z). 


For z € D», it is easy to derive 
U(g(z)) < U (2). 
For z € D3, it holds that 


U(g(z)) = V(x) + yaf (0W2(« + 1, e, h(x, e) 
V(x) + LAT + Le, h(k, e)) 
= U(z) 


IA 


where we have used Assumption 2.3. As a result, U(g(z)) < U (z) forallz € D. Note 
that since of the existence of the waiting time 7, there exist c; > 0 and c» > 0 such 
that for any (ti, j1), (t2, J2) € domz, jo — jı < c1(t2 — ti) + c». Therefore, systems 
(2.12) have persistent flow dynamics and UGAS of the set Y is concluded by similar 
arguments to that of [9]. 


Remark 2.2 From the designed functions foo, f;,; in Theorem 2.1, once a trigger- 
ing condition v < 0 is satisfied, the sensors will sample the output and sent it to the 
controller. The variable v will be subject to the following equation 
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ù = —p(v) + (x). 


Therefore, once v arrives at the value 0, it may increase because of the nonnegative 
term (x). This mechanism may avoid the probability of periodic sampling. 


2.4 Distributed Model-Based Dynamic Event-Triggered 
Control 


In this section, we consider the distributed case. Consider the following plant con- 
sisting of N subsystems: 


i = Do Aijxj + Biu, i € Q:={1,2,...,N} (2.20) 


j=l 


where x; € R”~ is the state of i-th subsystem. A distributed model-based controller 
is given as follows to stabilize systems (2.20): 


Â; = Auk; + Bui, 
uj = Kj x; (2.21) 


where Ax and B; are the ideal parameters of system matrices A;; and B;. Each 
controller (2.21) uses a model that omits the information of other subsystems and 
thus is distributed. We assume that each subsystem sends its state x; to the controller 
via a network .4% and there exist £; € Zs nodes in the network ./j. Let Taran 
be the sampling sequence of network -/4;. The variable x; can be divided into x; = 
(Xj1, Xi2, -.., Xje,) correspondingly with x;; € IR"; , In network .%, the transmission 
order of nodes is determined by the transmission protocols. The transmitted data x;; 
at time ti will arrive at the controller at ti + di where di is the transmission delay 
with 0 < d, « i 4 = ti. The sampling times of network .% are determined by the 
following event-triggered transmission strategy 


ty = inf(t > ti + Tlu; x 0} (2.22) 
where T; > 0 is the waiting time in network .%. The variable v; is subject to the 


following dynamic equation with initial value v; (1j) > 0: 


2] fuo(vi, xi (t), t € [t ti + Tj) 


Ùi . . 
fu aui, xi(t), ei(t)), t € [ty + Ti t) 


where e; :— X; — x; € R”«. The variable x; updates at fi + d, as 
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ECG + di)*) = ert BED (A, — iK); (5) + ix; G)) (2.23) 


where ®; (k) is a block diagonal matrix. The equation h; (k, ei) :— Un, — 9;(k))e; is 
called the transmission protocol equation of network ./;. The reason that £; updates 
based on (2.23) is same as the centralized case. 

Some assumptions are also needed as presented below. 


Assumption 2.4 The transmission delays satisfy 0 < d; < tř < Tj. 


Assumption 2.5 Foreach network .//(i € Q), the transmission protocols are UGES 
which means that there exist functions W; : Zo x IR" — Rzo which is locally 
Lipschitz continuous in its second variable, constants aj, aj? > 0, and constants 
Àj € (0, 1) such that the following conditions hold 


aiiļei| < Wilk, ei) < aioleil 
Wi(k + 1, hi(k, ei)) € Ai Wilk, ei). 


Moreover, there exist constants M; > 0, Aw, > 1 such that forall k € Z>o and almost 
all e; € R”« , it holds that 


< M; 


jane ei) 
Qe; 


and for all k € Zso and all e; € IR"«, we have 


Wi(k + 1, ei) < Aw, Wilk, ei). 


The entire closed-loop systems can be modeled into the following hybrid system 
by using a similar modeling approach to the centralized case: 


ze F(z,zeC€ 
n (2.24) 
z e Gz), zeD 
wherez := (x, e, s, v, l, t, K) e R':, x := (x1, xo, ..., xy) E€ R™,e := (e1, €2,..., 
en) € R™, s :— (51, s2, ..., Sy) € R”, ui-(vi, vo, ..., uy) € RY, L:= (h, b, ..., 
ly), t :2 (t4, D, ..., TN), K :— (K1, Ko, ..., Kw). The flow dynamics are subject to 
x = fix, e) 
e = fr(x, e) 
$ = f3(x, e, s) 
zeCc v= fa(x, e, v) (2.25) 
i=0 
tT=Hly 


K —0 
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where the flow set is defined as 


eser] U 


ieQ qe(12,3 
Rso, J; = 1, z; € [0, 77], ki € Z>0} 
Rso, li = 0, TE [0, Ti]. Ki € Z-9] 


Cii = (zlvi € 
Cio = (zlvi € 


Cig 
} 


Ci = [zlvi € Ro, lj = 2, T; E [T;, oo), Kj € Zo] 
and 
N 
fi (x, e) := A*x + B* Xe 
i=l 
fax, e) = (fai, e),-.., fav (x, e) 
Saves) Asi ey e, s), s ofan Oe) 
fa(x, e, v) = (fa (x, e, v), .... fan (x, e, v) 
foi(x, e) := (Aji — ABio)ei — AAjox; — Eix 
Aios; — AAjox; — B; Kie; — Eix, z€Ciü 
fai (X, e, s) := 
0, z € Cin U Cis 
fw. oui, xi), ZE Cj U Ci 
Sai (X, e, v) :— ' 
fo 1Qi, Xi, ei), z€Ci 
Ai Ar Ain 
A» A2 Aon 
Att T , . 
Ani cc: Ann-1 An 
B* := diag( Bi Ki, ..., By Ky} 
E; := (Ai e Aci On, Aga Aww) 
Aj := Aij + B; Ki 
Aio : = Âi + Bi K; 
AAjo :— Aii + B; Ki — A = BK; 
A Bio = Bj Kj = B,K;. 
Denote 


Di, :— Ci 


Di» := {z|u; = 0,1; = 0, v; = Ti, ki € Z>0} 
Di; := {z|u; = 0,1; = 2, v; € [T;, o0), k; € Zo]. 
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Then the jump set is specified as 


Ds |] om 


ieQ.qe(1.2.3) 


Let T; denote an N-dimensional diagonal matrix with the i-th diagonal element being 
zero and the other diagonal elements being 1 and let /7* denote an n,-dimensional 
block diagonal matrix consisting of N diagonal blocks as follows: 


diagIj, ,..., Di, > One o Du so Any} 
The jump map is specified as 


GG) =|] G 
ieQ 


where 


Ø, otherwise 


and 


G: (z) = v , ZE Diü, 


Gi(z) := ; z € Di», 
1+ Uy — Hi)lw 
T 


K 
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x 
e 
" Iscr = Df )h(k, e) 
G;(z) = U , £ € Dis. 
Dil Uy — TIi)w 
Ijt 


Ik + Uy — I) + Iw) 


Note that h(k, €) = (hy (ky, €1), este hy (ky; en)). 


We assume that bounds on the model uncertainties are known, as characterized 
in the following assumption: 


Assumption 2.6 The constants 54,, > 0, ôg > 0,i € Q are such that the model 
uncertainties satisfy | AAjo| < 54,,, |ABio| < ôB- 


To analyze stability of the subsystems (e;, s;), consider the following functions 


Ài 
Wii (ki, ei, Si) : = max{ W; (ki, si), i, Wilki, ei)}, 
Wio(ki, ei, si) : = Wi (ki, ei) 
Wi»(ki, ei, Si) : = Wi(ki, ei). 


Under Assumption 2.5, we can conclude the following lemma, 


Lemma 2.2 Suppose Assumption 2.5 holds. Then for all k; € Z-o, x € R™ and 
almost all e; € IR'*, s; € R”, it holds that 


Ə Wi, (Ki, ei, Si) 
| (fo (x, e), fail, e,5))| S Lu, Wii, + Hi, Œ) 
o (ei, Si) 
where Lig = Li» := Ea Hin (x) :— Mióaxi| + Mi|Eix|, and 
julia + ôs) MiQilAaol ee) 
Lit i= max d : 
"T Aidit 


We will use the following conditions to design the event-triggered transmission 
strategy. 


Condition 2.3 Suppose that there exist constants a; > O(j = 1, 2), positive definite 
functions $;, pi : IR» — Rso and x; : R": — Rzo( € Q), constants ô > 0, yj, > 
0, Vio = yi? > OG € Q), and a continuously differentiable function V : IR": > zo 
such that the following conditions hold: 

(Cl) a |x|? < V(x) < az|x|? for all x € R”, 

(C2) for all z € C, it holds that 
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3V N N 
a, fie SiE, e s) — 9 1d) — 2 fi 0D — va, Wii Ois €i, s), 


i=1 i=l 


(C3) for all x € R", e € R" andi € Q, 


HRE) + xi lei) + $i (i) 
> iW? (Ki, ei) + 2Ai Yio Wi (Ki, ei) (Lio Wi (ki, ei) + Hio(x)) + eii). 


Remark 2.3 Essence of (C2) in Condition 2.3 is that x-subsystem is input-to-state 
stable with respect to e and different gains are assigned to each error state e;, i € Q. 


The waiting time T; and upper bound t* of transmission delays for each network 
4%; will also be determined by associating a pair of differential equations. Consider 
the following two differential equations for each i € Q 


Tio = —2Lioztio — yio7t2) — Yio 
ví 

Tia = —2Lumu- Yio — (2.26) 
i0 


where yjo, yii > 0. 
The waiting time and upper bound of transmission delays will satisfy the following 
conditions. 


Condition 2.4 For à; € (0, 1), the pair (17, T;) with 0 < v? < T; satisfies the fol- 
lowing conditions 


1 1 
aà i 0 € his — , 
zs M00) € Bin = 


mio(Ti) = Ai, 7;0(0) < m1 (0), VO € [0,7] 


7i1(0) = 


where Trio, Ti; denote the solutions of (2.26). 


We are ready to present another main theorem of this chapter. 


Theorem 2.2 Consider the systems (2.24) under Assumption 2.4, 2.5, 2.6. Sup- 
pose Condition 2.3, 2.4 hold, then the set% := {0} x {0} x {0} x {0} x (0, 1,2] x 
RX x Zh is UGAS for systems (2.24) if the functions in transmission strategy (2.22) 
are designed as follows 


Jono lVi Xi) : = —pio(ui) + diri) 
Fu Qi Xi, ei) : = — pii (vi) + eii) — Xi (Ei). 
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Proof Consider the following function U : CU D > R: 


N 
U(z) = VG) - MU 


i=l 
where 


Vil; Til; (Ti) Wir Ki ej, Si) + uj, z € Cj U Ciz U Dj U Dio 


Ui (ei, Si, Vi, li, Ti, Ki) :— 
Ai Vio Wir (Ki, ei, Si) + Vi, z € CiU Dia. 


Using Lemma 2.2, we can derive from Condition 2.3 that for all z € C 


N 
U(z) < —àlGr e, s) — 3 ^ mintei (uj), pi (vi) 


i=l 


and using Assumption 2.5, we can conclude that for all z € D and g € G(z), U (g) < 
U (z). Because each local network has a waiting time, systems (2.24) have persistent 
flow dynamics. The remaining proofs are similar to that of Theorem 2.1. 


Remark 2.4 The paper [13] considers decentralized dynamic event-triggered trans- 
mission strategy for nonlinear systems with output feedback. The difference is that 
the controller in [13] uses the zero-order-hold while this chapter considers model- 
based dynamic event-triggered control. 


2.5 Example and Simulation 


Consider the linearized model of the interconnected pendulum used in [26, 47, 49]. 
The matrix parameters are as follows 


0 1 0 0 
2.9156 0 —0.0005 0 


auc 0 0 0 1 
—1.6663 0 0.0002 0 
0 0 0 0 0 
PNE 0.0011 0 0.0005 0 - —0.0042 
0 0 0 ol 0 
—0.0003 0 —0.0002 0 0.0167 


By = Bi, An = Ay, An = Ap. 


Such system is open-loop unstable. To stabilize this system, the controller gains 
are chosen as follows 
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Kı = [11396 7196.2 573.96 1199.0], Kz = [29241 18135 2875.3 3693.9 |. 


If each network has two nodes and the transmission protocols are Try-Once- 
Discard protocols then a4; = a12 = a2, = an = 1, Mı = My = 1 and Ay =A. = 
£i = àw, = 1 (refer to [29, 64]). We can compute Lig = 3.3582, Lii = 
561.0889, Loy = 3.3582, Lo = 1441.7, Hii (x) = 0.0013|x| in the absence of 
disturbances. Choose Lyapunov function V(x) :— x’ Px, parameter 5 = 0.001, 
$i (xi) = 0.02|x;|*, and transform (C2) of Condition 2.3 into linear matrix inequal- 
ity, then we can obtain 719 = y29 = 8.3 by LMI toolbox in MATLAB (these two 
gains can be optimized by function mincx in LMI toolbox). We can also obtain 
the gains yj; = y»; = 12. Therefore, we can choose pjo(vj) = pii (vi) = —2ui, 
gi (xi) = 0.02|x;|? and x;(e;) = 160]e;|? such that (C3) of Condition 2.3 holds. We 
run simulations with initial state xı (0) = x2(0) = (0.02, 0.02, —0.02, —0.02) under 
T; = 0.005 and constant delays tř = 0.001 for two cases: one uses model-based 
controllers for both subsystems and the other uses controller based on zero-order- 
hold for both subsystems. Both cases use Try-Once-Discard protocols in network 
M and M. Figures 2.1, 2.2, 2.3 illustrate the state trajectories and release inter- 
vals between two sampling points in both networks under model-based controller 
and Figs. 2.4, 2.5, 2.6 illustrate the state trajectories and release intervals in both 
networks with controller based on zero-order-hold. The simulations show that data 
transmission is sparse under model-based event-triggered transmission strategy while 
data transmission is dense under controller with zero-order-hold, and thus the pro- 
posed transmission strategy greatly reduces data transmission in network compared 
with the controller based on zero-order-hold. This illustrates the effectiveness of the 
proposed controllers in this chapter. 
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Fig. 2.2 Release intervals in 
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model-based controller 


Fig. 2.3 Release intervals in 
network ./5 under 
model-based controller 


Fig. 2.4 State trajectories 
with controller based on 
zero-order-hold 
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Fig. 2.5 Release interval of 0.035 
network í with controller 
based on zero-order-hold 


0.025 - È 


0.015 |], 


release interval 


0.005 


Fig. 2.6 Release interval of 0.03 
network ./5 with controller 
based on zero-order-hold 0.025 + 


0.02 } 


0.015 


release interval 


0.005 


2.6 Conclusions 


The results established in the previous sections consider only linear systems and 
state feedback. It is not hard to extend the proposed results to nonlinear systems with 
special forms, for example, 


ž = Ax + f(x) + Bu. (2.27) 


For systems (2.27), a model-based controller can be given as follows 


$= Â + Bu, u—Ki. (2.28) 


Following the same approaches as previous sections, we can also design the cen- 
tralized and distributed dynamic event-triggered transmission strategies for (2.27) 
and (2.28). Besides, suppose that systems (2.27) can be decomposed into subsys- 
tems. If some subsystems can be stabilized by state feedback and the other can be 
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stabilized by output feedback, then for state feedback subsystems, we can design 
model-based dynamic event-triggered transmission strategy and for output feedback 
subsystems, we can design dynamic event-triggered transmission strategy based on 
zero-order-hold as done in [13]. 


Chapter 3 A) 
Periodic Event-Triggered Control for get 
Decentralized Linear Systems with 
Quantization Effects and External 

Disturbances 


3.1 Introduction 


Quantization effects are almost inevitable in a sampled-data control system and 
the possible saturation of the quantizer may lead to instability of the closed-loop 
networked control system [5, 43, 45, 77, 85, 92]. The co-design of the event-triggered 
transmission strategy and quantization strategy has become a challenging and hot 
topic in recent years [1, 17, 18, 25, 39, 41, 50, 52, 53, 74, 81, 94, 95, 109, 110]. 

In [18], the authors consider model-based event-triggered controllers for linear 
systems with quantization effects and delays in the communication network. Asymp- 
totic stability is obtained with the logarithmic quantizer in [18] while the quantizer 
is assumed to have an infinite quantization region. In [52], the authors investigate 
event-triggered transmission strategies for nonlinear systems with finite quantiza- 
tion region in the absence of external disturbances, and the state can be steered to 
the origin by using dynamic quantizers. As for the case with external disturbances, 
the quantizer may be saturated and the system may become unstable [45]. In [17], 
a decentralized periodic event-triggered transmission strategy is considered for lin- 
ear systems with external disturbances in the presence of signal quantizations while 
the quantizer saturation is not addressed. The event-triggered transmission strate- 
gies in [53] use the estimation of external disturbances and input-to-state stability 
is obtained. The authors in [109] consider event-triggered sliding-mode controllers, 
and use zoom in and zoom out strategies for the dynamic quantizers to avoid satura- 
tion of the quantizers. In [1], the authors propose a hybrid algorithm for the dynamic 
quantizer when considering a dynamic event-triggered transmission strategy for non- 
linear systems with external disturbances. The system is input-to-state stable and the 
quantizer saturation is avoided. 

In this chapter, a hybrid algorithm of the dynamic quantizer is given for decentral- 
ized periodic event-triggered control systems with quantization effects in the pres- 
ence of external disturbances. The quantizer is assumed to have a finite quantization 
region. The entire closed-loop system is modeled into a hybrid dynamical system 
[22]. Without considering disturbances, asymptotic stability can be obtained for the 
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hybrid system and sufficient stability conditions are also derived. In the presence of 
external disturbances, .Z? gain performance is guaranteed. 


3.2 Preliminaries 


For a locally Lipschitz continuous function U : R” — R and a vector v € R”, the 
Clarke's generalized derivative of U along the direction of vector v is defined as: 


U hv) —U 
U°(x,v) = lim sup Gern o» 


yox,h—0* h 


The following lemma can be found in [46]. 


Lemma 3.1 Let R; and R, be two locally Lipschitz continuous functions from IR" to 
R. For the function R : R” — R defined by R(y) := max(Ri(y), R2(y)}, define sets 
Si :— {y|Ri(y) > R20), S2 :— {yl R10) < Ro) and 83 :— {y|Ri(y) = Ro(y)}. 
Then it holds that (I) for y € Sı, R°(y, v) = Ri (y, v); (II) for y € Sx, R° (y, v) = 
R3(y, v); (II) for y € S3, R°(y, v) < max( Ri Cy, v), R5(y, v)}- 


3.3 Model Description 


Consider the following decentralized system 


N 
i 2 Ajx; + Biu; + Eijwi, i € Q:5 (,2,.... N} (3.1) 


j=l 


where x; € R” is the state of the i-th subsystem, u; € R” is the control input of 
the i-th subsystem, and w; € R”™ is the external disturbance. To stabilize the system 
(3.1), use the following sampled-data controller for each subsystem 


uj = KiXi, t € [KT;, (k + D)T;) (3.2) 


where T; > 0 is a constant, k7;(k € Zso) are the detection instants, and x; € IR" is 
a variable at the controller side. 

For each subsystem, at the detecting instant KT;, a triggering condition will be 
checked to determine whether the state is sampled through a quantizer and then sent 
to the controller. The following dynamic quantizer will be used: 


Xi 
qu; (Xi) = Hiqi | — 
Hi 
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where q; is a static quantizer function. The static quantizer functions satisfy the 
following assumption. 


Assumption 3.1 There exist constants M; and A; with M; > A; > 0 such that the 
following implication holds for each i € Q: 


hal € Mi > lgiGi) — xil € Ai. 


M; characterizes the quantization region of the quantizer q; and A; is the quanti- 
zation accuracy. To ensure that the static quantizer is not saturated, we need to adjust 
the quantizer coefficient u; dynamically. 

Denote e; :— x; — x;. For the i-th subsystem, at each detecting instant, once the 
following triggering condition is satisfied 


lei| = oi|xi]; (3.3) 
the quantizer coefficient u; will be updated as g,, ; (xi, ni), which is defined as [92]: 


|x| xi | 


. lx; | lx; | Li 
gu, i (Xi, Ni) = i p, Z Eom (3.4) 
t I 
Hi, Li, < < Lu 


where L}, Li, and L; are constants satisfyingO < L^, < L; < L',,, < M; and each 


variable 7; satisfies the following ordinary differential equation 
"i = —CiNi 


with positive initial value. After the quantizer coefficient is updated, the state x; is 
quantized according to the updated coefficient, and then the quantized state q,,, (x;) is 
sent to the controller via the communication network. Once the controller receives the 
quantized state, the variable X; will be updated as q,,,(x;). Between two consecutive 
detecting instants, £; is subject to the following equation 


X = fi Gi, uj). 


We consider two cases in this chapter. One case is that the controller in each subsystem 
uses a zero-order-hold. In this case, we have Å (X;, uj) := Oforeachi € Q. The other 
case is that the controller in each subsystem is a model-based controller. In this case, 
f (Èi, uj) = Aji Xj + Bu; for each i € Q. 
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Introduce a logic variable p; € (0, 1) and a timer variable v; € [0, 7;] for 
each local network. The timer variable is used to generate the periodic detect- 
ing signal and the logic variable /; is used to identify whether a sam- 


pling happens. Let x :— (x1, x2, ..., xw) € R™, e := (e1,65,..., ey) E R", n= 
(Mm m,- ny) € RY, u := Qui Ma, ..., Un) € RY, T := (0, 0, ... tw) € RY, 
p := (py pas... Pw) € (0, 1], and w := (wy, wo, ..., wy) € R™. Denote z :— 


(x, e, n, uU, t, p). Then the entire closed-loop system can be formulated into the 
following hybrid system: 


zeF(znaw), zeC 


3.5 
zt € G(z), z € D. Pe 
The flow set C is defined as C :— Nn% C; where 
C; :— (z|ti € [0, Ti], p; — 0, ui € Reo, qi € Reo}. 
The jump set D is defined as D :— (he D; where 
4 
D; = U Diq 
g=l 
Dij :— (z|ti = Ti, pi =0, mi € Reo, ni € Reo, leil > oilxil] 
lxi 
Dio = {z\t = Ti, p; = 1, 0 € u; € max{n;, "na ni € Ryo, leil = oilxil) 


in 


Di; := {zltu = Ti, pi — 0, mi € Roo, ni € Reo, leil < oilxil) 


Dia = (z|ti = Ti, pi — 0, mi € Reo, ni € Reo, leil = o; xl}. 
The flow dynamics are subject to the following equation: 


x= Mx + Mne + Miaw 
e = Mix + Mne + Mw 


zec ERA 
i -—0 
t=ly 
p=0 


where c is a diagonal matrix with the i-th diagonal element being c; and 
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37 
Aj + Bik A12 ee AIN 
A21 An + B2K2 --- A2N 
Mi := ] : 
ANI AN2 s Any + BNKn 
Bi Ky Ej 0 --- 0 
BoK> 0 Ej. 0 
Mi» := , Mi3:= 
Bu Kyu 0 0 --- EN 
If a zero-order-hold is used by each local controller, then we have M»; := — M11, 
Mn := —Mı2, M»; := — M13. If a model-based controller is used for each subsys- 
tem, then we have 
O0 An- Ain Ai 
Ax 0 --+ Aon An 
Mog i3. s Qd Ma i= 
Anı Ám: O Ayn 
M3 (= — Mis. 


The jump map is given as G(z) := Wee gi(z) where g; is defined as: 


X 
e 
n 
z € Di 
Tin + Uy — Tsun) i: 
T 
Tip + Un — Ii)lw 
The Une T? )v 
, z € Di2 
8i) = x 
e 
ud z € Dia 
Tit 
P 
X 
e 
n 
, ZE Di 
Tic dn = Tu ISI x 
Iit 
ipd net P 


Ø, otherwise 
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with 


v := (Qi U2,..., UN): |v] € Aiki, i € Q} 
gu G, n) = (8,101); 85,2002); tt, Buy. NN) 
and 


x; | 


max(7—. ni], [xi] < Lips 
t 
lx; 
Um , Ix; > Lui 
L 
5 (x; :) 2 Hi, Li bi < |x; < L^ ti 
Spi i» Ni) = x; | : 
{max{ 77, ni}, Mi}, lxil = Linhi, Hi > O 
L 
|x;l i 
Upoub Ixi| = Loi, Mi > O 
t 
(0, ni}, Xi = 0, Hi =0. 


For the case w = 0, the data of system (3.5) satisfies the hybrid basic conditions 
[22]. In addition, we note that in system (3.5), 4; = 0 is allowed while in practical 
systems, according to the definition of functions g,,; in (3.4), u; will always be 
positive if the initial value of u; is set to be positive. Therefore, the hybrid model 
(3.5) can generate more solutions than the practical sampled-data systems. We can 
deduce stability of the practical systems from stability of the hybrid system (3.5). 


3.4 Stability and Performance 


In this section, we will analyze stability and performance of system (3.5) by con- 
structing a Lyapunov function. 
Define 


F; := (aii a9; «++ ayi) 


where aj; is a n,-dimensional identity matrix and aj;(j #i) is a ny, x ny- 
dimensional zero matrix. Denote H; :— F; M21. 
Next, we will present a condition for the x subsystem. 


Condition 3.1 There exist a continuously differentiable function V (x) := x" Px 
with P > 0, constants £ > 0, y; > OG € Q) and ô; > 0 such that the following 
inequalities hold 
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N 
(VV (x), Mux + Mne) € —(xl + lel?) + 3 olei? — x" H7 Hix — bix x). 


i=1 


(3.6) 


Moreover, there exist constants pi > 0, b; > 0 and Aj > 1 such that the following 
matrix inequality holds 


—H] H; — ôi  pi$; o; F7 Bj Ki; 


* y? — bing 


where x denotes an appropriate matrix in the symmetric matrix and S; := 
FI FiMui + MI FIF; + bi F] F; 


Consider the following ordinary differential equation for each i € Q 
Qi = —2Lidi — Vid} — vi (3.8) 


where L; > 0. If f (xi, uj) = 0 for each i € Q, then L; := |B;K;|. If f(x, ui) = 
AiiXi + Biu; for each i € Q, then L; := |Aiji|. 

Let $; beasolution of (3. idi wath initial value $; (0) :— A; € (1, oo). T; is a positive 
number such that $; (77) :— 

Next, we will present one of the main theorems. 


Theorem 3.1 Consider system (3.5) with w = 0 and assume Condition 3.1 holds. 
Suppose T; < T; and the following inequalities hold for each i € Q: 


P" 
, Lİ >A; fiti Cj > Àiyi. 


0xoiz 


Then the set W :— {0} x {0} x Ro x [0, z5]" x (0, 1)". is uniformly globally 
asymptotically stable for system (3.5). 


Remark 3.1 The analytical expression of the parameters 77" can be found in [9]. 
Proof of Theorem 3.1 Construct the following function for system (3.5) 
N 
U(z) := x" Px + 3 Viz) 
i=l 
where the variable x is part of the variable z, and 


Vi (z) := max{p;|x;|", dink, vidi (ti) lei! Js 


and d; > 0. 
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For each z € C and f € F(z, 0), we can derive 


N 
Ui. f) < 5 (—elx;|? — elei? + v?lei? — x" HJ Hix ^ éix x + Vj). (3.9) 


i=l 
We discuss all the cases for eachi € Q. 
Case I: p;|x;|? > max{djn?, vi; (ti) leil} 
For this case, using Lemma 3.1, we can derive 
V; = 2pix) (Fi Mux + B; Kiei) 
= pix! (Ff F.:Mu + MI F; F)x + 2pix! F/ B Kie;. (3.10) 


Using (3.7) and (3.10) yields that 
— elxi|? — elei? + y?lei? — x” Hy Hix — ôix" x + V; 


, 1 
2 2 21,2 T WT T 2 2 
< —e|xil^ — eleil^ + yf leil —x° H; Hix —óix x + Vi + bipi|xil — bins lel 
i 
5 2 
< —e|x;|" — eleil 
1 2 2 2 
s =a; (|xi| + leil* + ni) 
for some o] > 0. 
Case II: din? > max{p;|x;|", vipit leil} 
For this case, we can derive 


yr leil? — x” Hf Hix — ôixT x + V; < yr leil? — x! Hf Hix — 5x! x — dicin? 
< (yiii — cr) din? 
< —o7 (lxil? + lei? +7) 


A 


for some o? > 0. 
Case III: y;d;(1;)]e;? > max{p;|x;|*, din?) 
For this case, we can derive 


— elx;? — ele; + Ydle? — x” H] Hix — 6x7 x + V; 
< —e|xi? — ele; + Ydle? = x! Hf Hix — ôixT x 

+ vii Dle? + vidi (ti)2leil(Lileil + | Hixl) 
exi? — elei? — ixx 


—oa? (\x;|? + leil? + n?) 


IA 


IA 


for some o? > 0. 
Similarly, for the other cases, by using Lemma 3.1, we can also derive 
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2 2.2012 T jT T : Ans 24.2 
—e|xil* — ele |" + v£leit — x' H; Hix — óix x + Vi € ~a; (xil + leil +07) 


for some af > 0. 
As a result, we have shown that for any z € C and all f € F(z), it holds that 


U*(z, f) < -aU (3.11) 


for some a > 0. 
For z € D;, we discuss four different cases. 
(Dz € Di 
For this case, x, e, n, T keep unchanged and thus U (g) = U (z) for all g € G(z). 
(ID z € Di 
For this case, it holds for g € G(z) that 


Vi(g) = maxtpi|xi^, din?, yii Az p] 
< max(pilxil?, din?, yidi(T)leil?) 
= Vi(z) 


where we have used the following inequality 


2 
|x 
Vidi ADM? X yidi A? (maxi, [ou 
in 


< max{p;|x;|°, Vidi A n?) 


and d; is chosen to be larger than Vidi A. As a result, we have U (g) < U (z) for all 
g € G(z). 

MD z € Dis 

For this case, it holds that 


Vi(g) = maxtpilxil", din, yileil?) 
< max(oi xi^, din} 
< Vi(z) 
where g € G(z). As a result, we have U (g) < U (z) for all g € G(z). 


Similarly, for z € Dj4, we can also derive U (g) < U (z) for all g € G(z). There- 
fore, for all z € D, we have 


U (g) < U(z) (3.12) 
forallz € G(z). Combining (3.11), (3.12) and noting that the system (3.1) satisfies the 


average dwell time constraint, we conclude W is uniformly globally asymptotically 
stable. 
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Next, we will analyze .Z? gain performance of system (3.5) in the presence of 
disturbances. 
Condition 3.2. There exist a continuously differentiable function V (x) := x" Px 


with P > 0, constants £ > 0,0 > 0,9 > 0, and y; > OG € Q) such that the follow- 
ing inequality holds: 


N 
(VVG), Mix Mie) < —ellx? + lel?) + Y olei? — AP Ce, wi) — 8i lx? + wil?) 
i=l 


— (xl? — 9?|wp?) (3.13) 


where Hix, wi) := |F; Max — Eiwil. 
Moreover, there exist constants p; > 0, b; > O and A; > 1 such that the following 
matrix inequality holds 


—H] Hi — 6; + pi Si o; pi F] Bi Ki 
* —ó; — ET E; 0 <0 (3.14) 
ic * ye — biyi 


where x denotes an appropriate matrix in the symmetric matrix and 


S; := F} F; Mii + Mi, F7 F; + bi F] F; 
®; := MI F7 E; + p; Ff Ej. 


Theorem 3.2 Consider system (3.5) and assume Condition 3.2 holds. Suppose T; < 
T; and the following inequalities hold for each i € Q: 


IA: 
Osos Jf, Ly X Ai ~ Ci > Àiyi. 
prog [i 


Then system (3.5) is Ly stable with Lr gain 9 to the disturbance w in the sense that 
the following inequality holds for all t > 0 


1 


q B6 Pus) s BUCO), «0. 005) +0 (f wo. Pas. (3.15) 


where p is a class-.%55 function. 


Proof of Theorem 3.2 Using Lyapunov function same as that in the proof of Theo- 
rem 3.1, we can derive that for any z € C andall f € F(z, w), the following inequal- 
ity holds 
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U*G, f) < -aU — (|x|? — 9?|w[^), 
and for all z € D and g € G(z), the following inequality holds 
U(g) < U(). 


As aresult, for any solution z of system (3.5), the following inequality holds for any 
t>0 


of Ix (s, k)|?ds < U(z(0, oy + ew [ lw(s, k) p? ds. (3.16) 
0 0 


By using the fact that (k? + k2)2 < kı + ko holds for any kı, k2 > 0, the inequality 
(3.15) can be derived from (3.16). 


3.5 Example 


Consider the interconnected pendulum system which can be written into the form of 
system (3.1) with the following parameters 


01 . (00 . (0 . (0 
a= Go) tm (io) m0) e ) 


Aj := Ay, An := An, Bii Bi, Fy = En. 
The controller gains are chosen as: 
Ky, := (—6 —8) , Ko:— (-8 —10) : 


We first consider the zero-order-hold case. Each local controller uses a zero-order- 
hold between two consecutive detecting instants. Choose &; = ¢2 = 0.001, 6; = 
62 = 160. Then we can designo; = o» = 0.11 and Tj = T» = 0.01. The disturbance 
functions are set to be w1 (t) = wz = 5e~~ sin(5t). The initial values are set to be 
x1(0) :— (4110), x12(0)) and x2(0) := (x21 (0), x22(0)) with x11 (0) = x21 (0) = 0.1 
and x12(0) = x22(0) = —0.1. The quantizer parameters are set to be A = 0.5 and 
M = 30. We can choose Lli, = L?,,, = 20, Li = Lo = 22, and L} = L2, = 
30. For comparison, we also consider a situation that all the subsystems adopt the 
model-based controllers and the parameters of the quantizers and triggering condi- 
tions are same as that of zero-order-hold cases. 

The simulation time is 30s. With the controller based on the zero-order-hold 
for each subsystem, Figs. 3.1, 3.2 and 3.3 are respectively the state trajectories, 
the release instants and release intervals for x; subsystem, and the quantization 
coefficient JL. Correspondingly, we draw the figures with the model-based controller 
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Fig. 3.1 State trajectories 
under zero-order-holds 


Fig. 3.2 Release instants 
and release intervals for x4 
subsystem under 
zero-order-holds 
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for each subsystem in Figs. 3.4, 3.5 and 3.6. With the controller based on zero-order- 


hold for each subsystem, the transmission number is 219 for x, subsystem and 235 for 


x» subsystem. With the model-based controller for each subsystem, the transmission 
number is 67 for x, subsystem and 132 for x2 subsystem. The simulation results 
show that model-based controllers can generate less transmissions compared with 


the controllers based on the zero-order-hold. 


3.5 Example 


Fig. 3.3 Quantization 
coefficient u1 for x1 
subsystem under 
zero-order-holds 


Fig.3.4 State trajectories 
with model-based controllers 


Fig. 3.5 Release instants 
and release intervals for x1 
subsystem with model-based 
controllers 
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3.6 Conclusions 


A hybrid algorithm is proposed for decentralized periodic event-triggered control 
system with external disturbances. The proposed algorithm can ensure that the quan- 
tizer is not saturated. The entire system is modeled as a hybrid system. A stability 
condition is derived such that the hybrid system satisfies % gain performance in the 
presence of external disturbances. 


Chapter 4 A) 
Event-Triggered Stabilization for PAE 
Nonlinear Systems by Uniting the Local 

and Global Controller 


4.1 Introduction 


The main idea of event-triggered transmission is that a transmission happens only 
when it is necessary. In [80], the author proposes an event-triggered transmission 
strategy and the triggering condition is an inequality condition involving the system 
state and error variable. Then in [21], the author introduces an additional integrator 
dynamic and the transmissions are determined by the state of the integrator. Both 
of the authors in [80] and [21] prove that the Zeno phenomenon will not happen by 
showing that there is a minimal time between two adjacent transmission instants. 
For the case of output feedback, in [73] and [2], the authors impose a minimal 
time between two adjacent transmission instants. The Zeno phenomenon is avoided 
and asymptotic stability can be achieved in the absence of external disturbances. 
All of the works in [2, 21, 73, 80] require continuous checking of the triggering 
conditions. Differently, a periodic event-triggered transmission strategy does not 
check the triggering condition continuously, but checks it only at discrete detecting 
instants [28, 86, 107]. Linear systems are considered in [28, 107] where the former 
uses the hybrid system approaches and the latter uses a delay system approach. The 
more general case is the periodic event-triggered control for nonlinear systems. In 
[86], the authors model the nonlinear event-triggered control system as a hybrid 
system based on the framework in [7, 22, 23]. The hybrid system framework in 
[22] regards logic variables and timer variables as the system states and thus the 
researchers can construct Lyapunov functions containing these auxiliary variables 
[7, 9, 22, 23, 48]. The authors in [86] propose a novel Lyapunov function and stability 
conditions are derived based on Lyapunov functions. 

For nonlinear event-triggered control systems, all the aforementioned literature 
use a single global controller which sometimes has a large control gain. It has been 
demonstrated in [68, 72, 84] that when the state is near the origin, a local controller 
may achieve better performance, for example, only a small control gain is needed. 
The small control gain may lead to less transmissions compared with the global 
controller. On the other hand, the local controller may not stabilize the nonlinear 
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plant globally. This motivates us to consider a hybrid event-triggered transmission 
strategy. When the state is far from the origin, the global controller and a periodic 
event-triggered transmission strategy are used. In the event monitor at the plant side, 
there is a global norm observer [38, 75] thatis used to estimate the norm of the system 
state. At the periodic detecting instants, if the estimated state norm is near the origin, 
the output and a logic variable are transmitted to the controller. Once receiving the 
information from the plant side, the global controller is replaced by a local controller. 
Similarly, there is also a local state norm observer to estimate the state norm of the 
local systems [6, 71]. At discrete detecting instants, if the estimated state norm 
becomes far from the origin, the plant output and a logic variable are transmitted 
to the controller. The local controller will be replaced by a global controller. The 
challenges are that a hybrid algorithm needs to be designed such that the entire 
system is globally asymptotically stable while local performance is preserved. 

In this chapter, the main content can be summarized with the following points. The 
first one is that a hybrid periodic event-triggered transmission strategy is proposed 
for nonlinear systems. The hybrid transmission strategy consists of a global system 
and a local system. The global system has a global controller and a global periodic 
event-triggered transmission strategy. The local system has a local controller and a 
local periodic event-triggered transmission strategy. A hybrid algorithm is proposed 
to determine when a switch between the local system and global system happens. 
The second one is that the entire closed-loop system is modeled as a hybrid sys- 
tem which satisfies the hybrid basic conditions [22]. Global asymptotic stability is 
concluded for the resulting hybrid system which means that the proposed algorithm 
is also robustly stable with respect to small uncertainties. Two examples are given 
and the simulations show that the proposed hybrid algorithm reduces the network 
transmissions significantly. 


4.2 Motivation Example and Problem Description 


Consider the following scalar system 


x2—x.6)4u (4.1) 
where u is the control input. A network-based static controller is given as follows 
u=—Kx (4.2) 


where xX is the most recently transmitted plant state. Because there is a quadratic 
function 6x? in system (4.1), we choose a relatively large control gain to stabilize 
system (4.1) globally. But when the state variable x is near the origin, the high order 
terms —x? and 6x? can be neglected and thus the control gain K can be chosen as a 
small number. Specifically, let e := X — x. Then we have 
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L0 Q3 2 
x = =x +6x* — Kx — Ke. 

Choose a function V (x) := ix^. We can derive 


y- —x* + 6x3 — Kx? — Kxe 


x 9x? — Kx? — Kxe. 


K can be chosen larger than 9. When the state is near the origin, we can derive 
according to the linearized model V = — Kx? — K xe. In this case, we can choose 
a small gain, for example i Because the transmission of output is determined by 
an event-triggered strategy, we choose a hybrid transmission strategy. When the 
state is far from the origin, we use a global controller and a corresponding event- 
triggered transmission strategy such that the origin is globally asymptotically stable. 
When the state is near the origin, the event monitor sends a logic variable to the 
controller and the global controller is replaced by a local one. On the other hand, when 
the state becomes far from the origin, the local controller is replaced to the global 
one. Moreover, different transmission strategies are adopted along with different 
controllers. Simulation shows that a small control gain leads to less transmissions 
under the same triggering condition, for example, |e| > 0.3|x|. This motivates the 
hybrid event-triggered controller design. 


4.3 Hybrid Event-Triggered Stabilization 


Consider the following nonlinear plant 


i= fo(%,u), y= hy) (4.3) 


where x € R™ is the state, u € R”! is the control input and y € R” is the output. 
The functions f, and h, are continuous with h,(0) = 0. We consider the case that 
the output of system (4.3) is transmitted via the network to the controller. The trans- 
mission times are determined by an event-triggered transmission strategy. We use 
the combination of a local event-triggered controller and a global event-triggered 
controller. The global controller has the following form 


u = ki» 


where ĵ is the most recently transmitted plant output and &, is a continuous func- 
tion with kı (0) = 0. When the global controller is used, the transmission times are 
generated by a periodic event-triggered transmission strategy. More specifically, let 
{ti }¢2, be a periodic time sequence with t} dd — tl = T| where T; > 0 is a detecting 
period. At each time Hs the following triggering condition will be checked 
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W(e) = 91) (4.4) 


where e := ĵ — y € R™.W: R” — Ro ando; : R^» > Ryo are continuous func- 
tions to be designed. Once the condition (4.4) is satisfied at the detecting times, the 
output is sampled and transmitted via the network to the global controller. The entire 
closed-loop system with the global event-triggered controller can be formulated as 
the following hybrid system [22] 


x= fi(x,e, 1) 
e — fr(x,e, 1) t € [0, Ti] 
tT=1 
= (4.5) 
e' € g(x, e, T) t= Ti 
tT’  =0 
where fi (x, e, 1) := fp, ki(hp(x) + e)), fox, e, D := — Me f (x, ki (hp (x) + 
e)) and 
e, W(e) < o1y) 
£1(5,6, 7) := 10, W(e) > õi (y) 


{e,0}, We) 20:0). 
When the state x is near the origin, we use a local controller 
u = ko($) 
and a local periodic event-triggered transmission strategy. ko is a continuous func- 


tion with ko (0) = 0. For the local periodic event-triggered transmission strategy, the 
detecting period is Tọ > 0 and the triggering condition is as follows 


W(e) = doy). 


Then the entire closed-loop system with the local event-triggered controller can be 
formulated into the following hybrid system 


x = fi(x, e, 0) 
é= fo(x,e,0) =r € [0,7] 
T=1 
4 (4.6) 
X =X 


e" € go(x,e,t) t=T 
pw) 
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where fi (x, e, 0) :— fy Gc, kolhp X) + €)), fala, e, 0) = — 9€ p x ko (h Qc) + 
e)) and 


e, W(e) < o0(y) 
&o(x, e, T) := 4 0, W(e) > oo(y) 
{e,0}, W(e) = oo(y). 


As explained in the motivation example, the global event-triggered controller can 
stabilize the plant globally which means that the set 4% :— {0} x {0} x [0, Tı] is 
globally attractive for system (4.5). However, the global controller may need a 
large control gain. In contrast, the local event-triggered controller may need a 
small control gain but may only stabilize the plant locally which means that the 
set W :— {0} x {0} x [0, To] is locally asymptotically stable for system (4.6). Our 
aim is to seek a hybrid algorithm which combines the local event-triggered controller 
and global event-triggered controller. When the state is far away from the origin, a 
global controller is used and when the state enters near the origin, a local controller 
is used. We want to explore a hybrid algorithm such that the entire system is glob- 
ally asymptotically stable while the local performance is still preserved. Moreover, 
the hybrid algorithm should have certain robustness against the small measurement 
errors and uncertainties. Let q € (0, 1} be a logic variable. q = 1 means that a global 
controller is used and q = 0 means that a local controller is used. 

Next, a formal assumption about the global controller and local controller is 
formulated as follows. 


Assumption 4.1 The set 7/, is globally attractive for system (4.5). The set W is 
locally asymptotically stable for system (4.6). Moreover, the solution of the following 
ordinary differential equation does not blow up in finite time 


ge fi, e, 0) (47) 

é = f2(x, e, 0). 
Remark 4.1 The assumption that the solution of system (4.7) does not blow up 
in finite time is equivalent to that any solution is forward complete, which are mild 
constraints. Note that we have not presented the explicit conditions such that Assump- 
tion 4.1 holds because the design of periodic event-triggered controller for nonlinear 
systems has been well developed in the literature [86]. We do not introduce the con- 
ditions here to avoid redundancies. It is also interesting to consider the case that each 
controller uses a static event-triggered transmission strategy or a dynamic event- 
triggered transmission strategy. In the example section, we will present the detailed 
design procedures. 


The global convergence guarantees that the state variables x and e will converge 
to the origin. Because only the output y is accessible, we need to construct a norm 
observer to estimate the norm of the state x so that we know when to use a local 
controller. Similarly, we also need a norm observer for the local system so that we 
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know when to use a global controller. The norm observers can be implemented in 
the event monitor as illustrated in Fig. 4.1. The following assumptions are needed. 


Assumption 4.2 Suppose that there exist two continuous functions Up : R™ x 
R"- x [0, To] > R>oand Vo : R” — Ryo, functions oj, , Yu, y, &y € Ho, func- 
tions B; € J£ ZL (i = 0, 1), continuous positive definite functions p; (120,1), numbers 
0 < &o4 < €op and O < Ela < £15 such that 

Day (I(x. e, ba) < Volx, e, 7) < Tu (Gc e, Ty) anday (xD) < Voix) < 
à y (|x|) for all (x, e, x) € IR^: x R”! x [0, To], 

(2) The attraction domain of W for system (4.6) contains the set ((x, e, T)|t € 
[0, Tol, Uo(x, e, t) < Eta}, 

(3) the following global norm observer for system (4.5) 


ži —z + pı (u, y) 


is such that Vox (t, j)) < zı (t, j) + Bi (xå, 2) |, £) for any initial value (xj, zo) of 
(x, Z1), 
(4) the following local norm observer of system (4.6) 


Zo = —zo + pole, y) 


is such that Uo(x(t, j), e(t, j), T(t, j)) € zo(t, J) + Boda, z9), t) for any initial 
value (xp, z8) of (x, zo), 

(5) any solution (x, e, T) of system (4.6) starting from {(xo, 0, 0) : Vo(xo) < £1p} 
satisfies po(e(t, j), y(t, j)) < £oa for all (t, j) € dom(x, e, T). 


Remark 4.2 For continuous-time systems, the existence of a norm observer can be 
deduced from input-output-to-state stability [38, 75]. Let us recall input-output-to- 
state stability for the nonlinear plant (4.3). System (4.3) is said to be input-output- 
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to-state stable (IOSS) if there exist two functions f € X-Z and y € Xa such that 
any solution x of system (4.3) satisfies the following inequality 


Ix] < max(f (xol, t), 7 Ps I»G)D. VC i |u(s)|)}. 


IOSS implies the existence of a continuously differentiable function V : R^: — Rso 
such that 


e There exist functions v1, v2 € J£ satisfying vı (|x|) < V (x) < vo(|xp) forall x € 
R” , 
e There exist functions 9j, 91 € J£ such that 


VV (x) f(x, u) < —V(x) + pl ul) + Ad (ly). 


Then pi (u, y) can be taken as pi(u, y) :— 1 (|u|) + P2(|y|). Note that the system 
(4.5) satisfies the dwell-time condition. Therefore, a global norm observer can be 
constructed as given in Assumption 4.2. A norm observer for hybrid systems can 
be deduced from output-to-state stability. Therefore, the main assumptions are an 
assumption on IOSS for the continuous plant and an assumption on output-to-state 
stability for hybrid system (4.6). These results have been well developed in the 
literature [6, 38, 71, 75]. 


Now we are ready to propose the following hybrid event-triggered control algo- 
rithm. 


Hybrid algorithm: 

(1) When q = 1, the global event-triggered controller is used. The state variable 
(x, e, 1) is governed by the hybrid system (4.5). In the meantime, at some periodic 
detecting time, if z1 < £o», then the logic variable q is reset to 0. The logic variable 
and the plant output y are sent to the controller. Once receiving the information from 
the plant side, the global controller is replaced by a local event-triggered controller 
and y is updated as the received plant output y. 

(2) When q = 0 and zo < £oa, the local event-triggered controller is used. The 
state variable (x, e, t) is governed by the hybrid system (4.6). In the meantime, at 
some periodic detecting time, if zo > £oa, then the logic variable is reset to 1. The 
logic signal and the plant output y are sent to the controller. The local controller is 
replaced by the global event-triggered controller and y is updated as the received 
output y. zo is also reset to zero. A 


Remark 4.3 If the plant state is accessible, we do not need the norm observers 
and the hybrid algorithm can be simplified. The jump condition from the global 
controller to local controller is Vo(x) < £o and the jump condition from the local 
controller to global controller is Uo(x, e, T) > £oa. Besides, (x|Vo(x) < £op} is a 
subset of {x|Uo(x, 0, 0) < e1,) and any solution of system (4.6) starting from 
{(xo, 0, O)| Vo (xo) < £op) satisfies Uo(x, e, t) < £oa. As a result, when the global 
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system is replaced by the local system, the state is within the attraction domain of 
the local system. 


Because the global controller stabilizes the plant globally, the global controller 
can be replaced by the local controller after sufficiently long time. 

Let x :— (x, e, zi, zo, T, q). The entire closed-loop system can be formulated into 
the following hybrid system 


X=FOO, xeC 


xt eG), xeED. m 


The flow dynamics are specified as follows 


x= fio. e, q) 

e — fo(x.e,q) 

ż1 = —z1 + pilke(hp(x) + e), hp(x)) 
zo = (1 — q)(—zo + pole, hp(x))) 
t=1 


q=0. 
The flow set is C := C; U C5 where 


Cı := {x :q4 = 1, t € [0, Ti]; zo = 0, zı = 0} 
C2 := {x :4 = 0, t € [0, To], zı = 0, zo = 0}. 


The jump set is D := u$ Di where 


Dı := {x :4 = 1, t = T], z1 < €0p, zo =O} 
D2 := {x :4 = 1, t = T], z1 > £b, zo =O} 
D3 := {x :4 = 1, t = T], z1 = €0p, Z0 = 0} 


D4 := (x :4 = 0, t = Tọ, zi = 9, zo > £0a} 
D5 := {x : q4 =0, t = To, zy > 0, zo < £0a} 
Dg := (x :4 =0, t = Tọ, zi = 0, zo = £0a}- 


The jump map is 
(x, 0, z1, zo, 0, 0), x € Di 
G1(x), x € D2 
(x, 0, z1, 29,9,0) U G1OO. x € D3 
G(x) := 
(x, 0, z1, 0, 0, 1), x € D4 
G2(x), x € D5 


(x, 0, z1,0,0, 1) UG2(x), x € De 
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where 
Gi(x) := 1 (x, e, 21, Zo, 0, D, W (e) < a(x) 
(x, 0, z1, Zo, 0, 1) U (x, e, 21, Zo, 0, D), W(e) = oi (x) 
and 
(x, 0, Zl; Zo, 0, 0), Wee) > do(y) 
Go(x) := 1 (x, e, zi, Zo, 0, 0), W(e) < doy) 


(x, 0, z1, Zo, 0, 0) U (x, e, z1, Zo, 0,0), We) = do(y). 


From the flow set and jump set, we can see that at the discrete detecting instants, 
the event monitor at the plant side checks not only the triggering condition but also 
the switching condition to determine whether a controller switching is necessary. 
We will show under the proposed hybrid algorithm, no matter what the initial logic 
variable q is, q will eventually jump to 0 after finite jumps. Moreover, the state will 
converge to the equilibrium set. 

The flow set and the jump set are closed subsets of IR"*. Because the functions 
fp; hp, ki, ko, po, pı are continuous, the functions fj and fz are continuous with 
respect to the variables x, e,q relative to the flow set. Then the flow map F is 
continuous relative to the flow set. The jump map is continuous at the points belonging 
to Dj, D4 and outer semicontinuous at the points belonging to the sets D2, D3, Ds. 
Then the jump map G is outer semicontinuous with respect to the jump set. Therefore, 
the data of hybrid system (4.8) satisfies the hybrid basic conditions [22]. We are ready 
to present one of the main theorems. The proof is inspired by that of [68]. 


Theorem 4.1 Consider system (4.8) and assume Assumptions 4.1, 4.2 hold. Then 
the set Y :— (0) x {0} x {0} x (0) x [0, To] x {0} is globally asymptotically stable 
for system (4.8). A 


Proof of Theorem 4.1 To show global asymptotic stability, it is enough to show 
the set W is locally stable and globally attractive. We firstly show local sta- 
bility. Let € be an arbitrary number with 0 < € < £oa. Because the functions 
po, P1, hp, ko, ky are continuous and vanish at zero, there exists a à? > 0 such 
that oi(ki(e + hp(x)), hp(x)), pole, hp(x)) < $ for all |(x, e)| < 62. From the 
stability assumptions in Assumption 4.1, there exists a ô; > 0 such that any 
solution (x,e,t) of system (4.6) with initial value |(xo, eo, to)| ^, < 51 satisfies 


(a, j) elt, js TE, Db < min{5, ô2}. The initial values of zo and zı can be 
chosen less than 7 Then zo and zı are less than i Therefore, we can choose 


ô < min(ó,, 1}. Any solution x with initial value | xol» < ô satisfies | x (t, lw < € 
for any (t, j) e domx. 
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Now we prove global attractivity. The proving procedures rely on the following 
two claims. 


Claim 1 For any solution x of system (4.8), if there exists a hybrid time (tk, jx) € 
domy such that g(t, j) — O for all (t, j) € domx with t+ j > t; + jy, then 
lim; joo Ix, Dlw = 0. 


Proof Suppose that there exists a hybrid time (tk, jy) € dom yx such that q(t, j) = 0 
for all (t, j) € domx with t+ j > tk + jy. Then for x(t,j) e D and t+j> 
tk + jk, Zo(t, J) < €oa- For sufficiently large t + j with (t, j) € domx, fo is suf- 
ficiently small and thus Uo(x(t, j), e(t, j), t (t, j)) € €1q according to condition (4) 
of Assumption 4.2. Then according to condition (2) of Assumption 4.2, x (t, j) 
approaches the set WY as t + j approaches oo. 


Claim 2 For any solution x of system (4.8), there does not exist a nondecreasing 
sequence of hybrid times (t, jk) € domy such that 


q(bx, ja) = 9, qoas fox) = 1. (4.9) 


Proof We prove Claim 2 by contradiction. Suppose that there exists a sequence sat- 
isfying (4.9). Without loss of generality, we can assume that between (t5, j2,) and 
(tors, j2k+1 — 1), q = 0 and between (fii, j2k+1) and (c5, j2k+2 — 1), q = 1. 
The logic variable q is updated as 1 from 0 at the instant (fo¢41, joy, 1 — 1). It is 
updated as 0 from 1 at the instant (121,5, for+2 — 1). From the jump set, we know 
Z1 (tor+2, tor42 — 1) < €op. Because each two adjacent jumps are separated by a 
positive number, for sufficiently large £21,» + joy», we have Vo(x (for+2, t2k+42 — 
1)) < ey, by using condition (3) of Assumption 4.2. Besides, e(foxi5, jor42) = 0 
based on the jump map. Combining conditions (4), (5) of Assumption 4.2 and 
Zo(tok+2, J2ək+2) = 0, we have zo(t, j) < €oa for all (t, j) € domx with t+ j> 
toe+2 + jor+2. Therefore, g(t, j) = 0 for all (t, j) € domx with t+ j > to45 + 
Jok+2 Which is a contradiction. 

Combining Claim 1 and Claim 2, we can conclude that the set W is globally 
attractive and thus globally asymptotically stable. The proof is completed. 


We have shown that the proposed hybrid event-triggered controller stabilizes 
the nonlinear plant globally. In practical applications, there exist various kinds of 
uncertainties such as measurement errors and model uncertainties. Next, we will 
show that the proposed hybrid algorithm is also robust to such uncertainties. Consider 
the perturbed hybrid system of system (4.8) as follows 


X € Fx) X ECs 


(4.10) 
x+ € G(x), x € Ds 
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where the data are specified as follows 


F5(x) := COF (x + 6B) +ô 
Gs(x) := {v : v € g + ôB, g € G(x + ôB)} 
Cs (x) = {x : (x + ôB) N C £ Ø} 
Ds (x) := {x : (x + ôB) N D F Ø}. 


The following robustness result can be concluded. 


Theorem 4.2 Consider system (4.8) and assume Assumptions 4.1, 4.2 hold. Then 
the set W is robustly stable for system (4.8). Specifically, there exists a function p € 
KH L such that for any compact set Ê and number € > 0, there exists a ó > 0 such 
that any solution x starting from € of the perturbed system satisfies |x (t, j) y < 
B(Ix (0, Oly, t +j) +e. A 


Proof Because the set // is compact and the data of system (4.8) satisfies the hybrid 
basic conditions. The proof is completed by applying Lemma 7.20 of [22]. 


4.4 Example Studies 


In this section, we consider two examples to illustrate the improvement over the 
existing literature. One example considers the state feedback control and the other one 
considers the output feedback control. We will compare the hybrid event-triggered 
controller in this chapter with the global periodic event-triggered controller [86]. 


Example 1 Consider the following system from [4] 


Xx -X +u. (4.11) 
The existing literature uses the global controller u = —2x. Differently, near the ori- 
gin, we will use the following local controller u = —0.1%. It can be verified by sim- 


ulation that the local controller cannot stabilize the nonlinear plant globally because 
of the small control gain. 


Global event-triggered stabilization: 
The function fo(x, e, 0) satisfies | f2(x, e, O)| € Lile| + H1(x) with Hı (x) := 
|x? — x? — 2x| and Lı = 2. For the global periodic event-triggered control, choose 


the function Vi (x) := Ay? + d yi for the x subsystem. Then we have 


VV (x) fi(x, e) = (x? — x* — 2x? — 2ex)d 
+ (x? as cmt. — 2x? e)d. 


4x + 4x? — 2x5 — 4x? — H? (x). 
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Choose d; = 8 and dy = 2. Then we can obtain 


VVi(x) fi(x, e) = —x® — 3x4 — Ax? — 8x? — 16ex — Ax?e — H?’ (x) 


TE — 4x? — e + ype — H?(x) 


with y, = 6.1. 
Consider the Lyapunov function Uj (x, e, t) = Vj (x) + max{ Zx, yiói OW? (e) 
with W (e) = |e|. The function $, satisfies the following differential equation 


bi(t) = —2Li¢1(t) — ibd) — yi, c € [0, 7i]. 


Choose $,(0) — 2 and $,(Tj) = 0.5. Then T; can be solved to be 0.08. We 
compute the Clarke's general derivative U; of U; and the computation can 
be divided into three cases. One case is Zx]? > yı$ıW? (e), the second case 
is xp < yi$1W?(e) and the third case is 2 |x|? = yıġı W° (e). For all the 
cases, we can derive UP (x, e, T) < —a(|(x, e, t)|y,) for some function a € 2%. 
In the jump set, when W(e) > (y), e is reset as zero and thus the func- 
tion U; does not increase. Let o (y) := 0.1|x|. When W(e) < (y), e does not 
change and thus U;(x*,et, t+) — Uj(x,, e, v) < max(— |x|?, yidi(0)W?(e)) — 
2x? because W (e) < (y) implies W? (e) < yz lel. The function U, decreases 
during continuous evolution and does not increase during jumps and the jumps are 
separated by a constant time. Therefore, 7/; is globally asymptotically stable. 


Hybrid event-triggered stabilization: 

For the local event-triggered control system, we have | f2(x, e, 0)| < Lole| + 
Ho(x) where Lg = 0.1 and Ho(x) := |x? — x? — 0.1x|. 

For the local system, choose the function | Ug(x):— Vo(x) 4 
max{b|x|*, YoQo(1) W?(e)) where Vo(x):— 4x? and b —0.1. When b|x|? < 
Yoo (t) W? (e), we can derive 


US (x, e, t) = —0.8x? — 0.8ex + (8x? — 8x4) + yoéoW? (e) 
+ 2yopoW (e) (LoW (e) + Ho(x)) 


where ġo satisfies o = —2Lo$o — 2p — 2. 
When b|x|* > yobo(t) W? (e), we can derive 


Ue = 8x(x? — x? — 0.1x — 0.1e) + 2bx(x? — x? — 0.1x — 0.1e) 
= —0.8x? — 0.8ex + 8x? — 8x44 2bx (x? — x? — 0.1x — 0.1e). 


To compare fairly, choose To = T, and = Go(y) =0.1|x|. Then 
{(x, e, T)|Uo(x, e, T)} <4 x 107^ is an attraction domain because in this set, we 
have |x| x 0.01 which leads to U < —eg(|(x. , e, T)|w) for some ap € #3 and 
Ug(x*, et, t+) < Ug(x, e, t). We can choose egy = 2 x 107^ and £oa = 4 x 1074. 
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The initial state for x is 50. The simulation time is 30s. The state trajectories are 
plotted in Figs. 4.2 and 4.4 for different controllers. The transmission instants and 
transmission intervals are plotted in Figs. 4.3 and 4.5. q is plotted in Fig. 4.6. It can 
be observed from Figs. 4.3, 4.5 and 4.6 that the logic variable finally jumps to 0 
and the transmission intervals of hybrid controller are significantly larger than that 
of the global controller when the state enters near the origin. This shows that the 
proposed algorithm reduces the transmission number heavily. 


Example 2 Consider the following system where only part of the state is available 


ko = —x_ + x? (4.12) 
yox 
The global controller is designed as u = —4X,. Near the origin, the local controller 


is designed as u = —0.2X,. The function fə satisfies | f(x, e, 1)| < Lyle] + Hi (x) 
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Fig. 4.4 State trajectory 
with hybrid controller 
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Fig. 4.6 Logic variable with 
hybrid controller 
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where Lı = 4 and Hı (x) = |x? — A + x» — 4xı|. We firstly design the parame- 
ters for the global systems. Choose the function Vi (x) :— 4x7 + 2x1 + 2x2. We can 
compute that 


dV (x) 
Ox 


fia,e= 8x1 (x? — x? + x2 — 4x; — 4e) 
+ 8x? (x? — x + x2 — 4x, — 4e) + 4x2 (—x5 + x?) 
+ xÉ — a + gar — uox — 8x} + 2x? x9 + 16x? 
+ x — 8xqx» — H?(x) 
= —7x8 + 6x; — 31x] + 6x2xF + 6x2x5 — 16x? — 3x7 


32xje — 32x1e — H’ (x) 


IA 


3 1 
5H 4x4 16x? 5% 32x1e 32xFe H?(x) 


IA 


1 
4x — 12x? 36 +? We) - Ho) (4.13) 


where yi = 16. Choose the function . Uj(x,e, 1) :— Vi(x) + 
max{“|x1|, yid (0) W?(e)) where 1 satisfies $i = —2Liói — 1107 — y 
Let $4(0) 2 2 and $,(T1) = 0.5 which leads to 7; = 0.03. Choose a = 4 and 
O1(y) :— DIET |. We can verify U? < —a(|(x, e, tT)|y,) for some function a € %3 
and U;(xt, et, t+) < Uj(x,e, x) for t = Tj. Because the jumps are separated by 
a constant time, the set 7/4 is globally asymptotically stable. 

For the local systems, | f2(x, e)| < Lole| + Ho(x) where Lo = 0.1 and Ho(x) := 
la? — ue + x5 — 0.2x,|. Choose Vo (x) := 10x? + 40x2. Then 


9 Vo(x) 
Ox 


fix, e) = 20x? — 20x7 + 20x1 x2 + 20x1 u — 80x2 + 80x? x2 
< —Vo(x) + 60x1 + 20x + 20x? — 10x2 + 20x1u. 


We can design pi (u, y) := 60x4 + 20x? + 20x? + 20xiu. 
For x € (x'|Vo(x^) < 1073), 289 f(x, e) < —0.3x? — 30x3 + Se?. 
Let Ug(x, e, T) := Vo(x) + max{b|x,|7, YoQo(1) W?(e)) where ġo satisfies do = 
2Logo vpi yo With yo = 2.3. Choose b = 0.04, po (0) = 2 and ġo (To) > 0.5. 
To compare fairly, we also choose Tọ = Tj and Go(y) := i [x1]. It holds that 
Us < —Uo + 2x6 + 62x} + 20.08x + 19x? -- 2W?(e). Then the function po can 
be chosen as po(e, y) :— 2x° + 62x} + 20.08x7 + 19x? + 2W?(e). 

When Uo(x, e,t) < 102, we can verify Ug < —ao(\(x, e, T) 4) for some 
ay € Ha and Ug(x*^, et, t+) < U(x, e, 1) for t = Ty. Choose £j, :— 4 x 1074, 
£0p = 3 x 1074, £1a :— 107? and eg, :— 9 x 107^ such that conditions (2) and (5) 
of Assumption 4.2 hold. The state trajectories are plotted in Figs. 4.7 and 4.9. The 
transmission instants and intervals are plotted in Figs. 4.8 and 4.10. The logic vari- 
able is plotted in Fig. 4.11. It can be seen that with the proposed hybrid algorithm, 
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the global controller is eventually replaced by the local one and the state value will 
enter the attraction domain of the local system. The transmissions are significantly 
reduced with the hybrid transmission strategy. 
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4.5 Conclusions 


This chapter proposes a hybrid event-triggered controller for nonlinear networked 
control systems. The controller consists of a global periodic event-triggered controller 
and a local periodic event-triggered controller. A hybrid algorithm is proposed to 
determine when a switch between the local system and global system happens. The 
resulting system is modeled as a hybrid system which satisfies the hybrid basic 
conditions. Global asymptotic stability and robust stability are concluded. 


Chapter 5 A) 
Event-Triggered Control for Nonlinear i 
Systems With Stochastic Dynamics, 
Transmission Instants and Protocols 


5.1 Introduction 


The event-triggered transmission strategies in [21, 80] require continuous monitoring 
of the inequality conditions, and the Zeno phenomenon is precluded by showing 
that there is a lower bound between two consecutive transmissions. Differently, the 
periodic event-triggered transmission [27, 28, 86, 107] does not need to monitor 
the triggering condition continuously, but checks the triggering condition at discrete 
times. In [28, 107], periodic event-triggered transmission strategies are proposed for 
linear systems, where the detecting actions are taken periodically. In [86], the idea of 
a periodic event-triggered transmission strategy is extended to nonlinear systems and 
the closed-loop networked control system is modeled as a hybrid system. Stability 
conditions are derived by constructing a Lyapunov function where the timer variable 
and logic variable are considered part of the system state. 

In the periodic event-triggered transmission [28, 86, 107], the triggering condition 
is checked periodically which means that the time intervals between two consecutive 
detecting instants are constant. Another possibility is to consider the situation where 
the discrete detecting instants are stochastically distributed. Several observations 
make stochastic detecting instants reasonable and meaningful. Firstly, in the real 
world, the timer that generates the periodic detecting signals has an accuracy error 
that may be stochastically distributed. Secondly, stochastically distributed detecting 
instants allow a relatively large duration of the detecting period with low probability. 
A similar idea has been considered in [30, 33], which do not consider the event- 
triggered control problem. 

Motivated by the above observations, this chapter aims at analyzing stability of 
stochastic event-triggered nonlinear control systems with stochastic noise and pro- 
tocols [9, 33, 93]. Stochastic event-triggered transmission implies that the discrete 
detecting instants are generated by a stochastic timer signal, which allows that the 
detecting interval is relatively large with low probability and relatively small with 
high probability. Besides, multiple network nodes are also considered and, at a trans- 
mission time, which node is transmitted is determined by a stochastic transmission 
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protocol. The challenging point of this work is how to model and analyze the entire 
closed-loop system exhibiting stochastic behavior and hybrid behavior. 

The main content of this chapter can be summarized as follows. Firstly, a stochas- 
tic event-triggered transmission strategy is proposed for nonlinear stochastic systems 
under stochastic transmission protocols in the network. A novel stochastic networked 
control system model is established based on the stochastic hybrid system frame- 
work proposed in [83]. Secondly, a novel twice continuously differentiable Lyapunov 
function is constructed, which can be used to deal with stochastic noise in the plant. 
The Lyapunov function contains a timer variable which is regarded as part of the 
system state. Stability conditions are derived to guarantee asymptotic stability in 
probability for the resulting system. 


5.2 Model Description 


Consider the following stochastic system 
dx, = fy(xy, u)dt +1,(xp,u)dw, y = hy(xy) (5.1) 


where x, € R"? is the state, y € R™ is the output, u € R”! is the control input, 
and w denotes an n,,-dimensional Brownian motion. The output function h, can 
be written as A, (xy) :— Qu (Xp), REA hn, (xp)) € R™ and each h; is assumed to be 
twice continuously differentiable. 

The output of system (5.1) is monitored locally and when a triggering condi- 
tion is satisfied, the output is transmitted via a communication network to a remote 
controller. The network-based controller is given as follows 


ke = fete, $), U = kX, 3) (5.2) 


with y € R”’. 5 will be updated at discrete transmission instants which are determined 
by the stochastic event-triggered transmission strategy and, between two consecutive 
transmission instants, 9 is kept constant by a zero-order-hold. Let e := $ — y € R”? 
with n, = ny. Assume that there are £ nodes in the network and y can be parti- 
tioned into y := (yi, y», ..., ye) with y, € IR" correspondingly. Then e can also be 
partitioned into (ei, e2, ... , e¢) with e; € IR"« and ne, = ny. 

A triggering condition will be checked at stochastically distributed detecting 
instants by a local event monitor. If the triggering condition is satisfied at some 
detecting time, some node j will have access to the network, and the data y; collected 
by the sensors is transmitted to the controller. Which node has access to the network 
is determined by a stochastic transmission protocol. Specifically, if the triggering 
condition is satisfied at some detection instant, then y will be updated according to 


jt = y + hle, v1) (5.3) 
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where v, is a random variable taking values in (1, 2, ..., £} with distribution 44. 
h(e, vi) is defined as follows 


h(e, v) :=  — Ty)e 
where / is the identity matrix and I',, is a block diagonal matrix 
Py, :— diag(0,, ,... On. JT, UE osa Un, d 
with UM being the n,, x ne zero matrix. The Eq. (5.3) can be written as 
et = h(e, vi). (5.4) 


The updating Eq. (5.4) is seen as the stochastic transmission protocol equation. 
Assume that the stochastic transmission protocols are stable in the following sense 
(see [79]). 


Assumption 5.1 Thereexistatwice continuously differentiable function W : R"e > 
IR, constants a, a2 > 0 and à € (0, 1) such that the following inequalities hold for 
alle e R” 


aile? € We) < alel? 


£ 
XU Wahle, loui) < AW (6). (5.5) 
k=1 


Remark 5.1 Consider a quadratic function W (e) := e" Qe where Q is a positive 
definite diagonal matrix. Then we have 


£ 
We. Dui (k) x XW(e) 
k=1 


witha = (1 — mingesy,2,...,.¢ 41 (k)), which satisfies Assumption 5.1 if 4; (k) € (0, 1) 
for any k € {1,2,..., £}. It is also interesting to consider the other stochastic proto- 
cols, for example, Markov scheduling protocols. 


At stochastically distributed discrete detecting instants, the following triggering 
condition will be checked 


We) > qo(y) (5.6) 


where ø : R — Rs» is a continuous function, and q > 0 is a coefficient. 
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Introduce a timer variable t € R that will be used to generate stochastically dis- 
tributed discrete detecting instants, and denote x :— (x, e, t). The entire closed-loop 
system can be modeled into the following stochastic hybrid system 


dx = F(x)dt+ B(x)\dw, xec 


5.7 
xt € G(x, v*), x € D. 5.7) 


The flow set C is specified as C := {x|t € [0, Tinax]} and the jump set D is 
specified as D := {x|t = 0}. 
The flow dynamics are specified as follows 


dx = fi(x, e)dt + bi (x, e)dw 
de = fa(x, e)dt + ba(x, e)dw (5.8) 
dt = —dt 


where fo(x, e) := (Jfa (x, e), ..., fon, (x, e)) E R”, 


els fpGQp, k(Xe,h (xp) +e)) 
^eo:- ( p uc (e) ) 


_ hi A 
as Fee ys p&p Kes hy (x5) + e)) — nE (V?hj)l,) 
b.e): ( tps Kc, hyip) + D 

9h, (xp) 
neue EN ON k(xc, hy (xp) + e)). 


and I, in f»; is [5 (xp, k(xc, e + hp (x5))). The jump map is specified as 


(x, e, v2), Wie) < qo (y) 
G(x, v) := 4 Go h(e, vi), v2), W(e) > qo (y) (5.9) 
(x, te, h(e, vi)), v2), We) = qo (y) 
where v; and v2 are two independent random variables. From the model, once the 
stochastic timer reaches zero, the triggering condition (5.6) will be checked and the 
jump map captures all the possible cases. 


i41 and u, are respectively the distribution functions of v, and v2. The distributed 
functions 4, and uz satisfy that 


pa (1. tta £}) = 1, M2(LT, mins» Tnax |) = =1 (5.10) 


with the parameters satisfying 0 < Tmin < Tmax- 
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To clarify how the model generates the stochastically distributed detecting times 
note that, at each reset time, the timer T is set to a random value in [7;;,, Tmax] almost 
surely and then, due to the timer's continuous-time dynamics and the definition of 
the jump set, the next reset time is equal to the current reset time plus this random 
value. 

It should be noted that the inequality (5.6) can be checked by the event monitor 
because the event monitor can access to the output vector without network commu- 
nication if the nodes are located near each other. This setup has been adopted in [14, 
86]. 


5.3 Stability Analysis 


With the function W in Assumption 5.1, two coupling conditions are imposed for 
stability analysis. 


Condition 5.1 There exist a constant L > 0 and two functions H : R” > Rso, N : 
R” — Rso such that the following inequality holds for all x € IR^: and e € R” 


OW (e) 
de 


fox, e) STOF (V? W)bs) x LW(e) --24/W(e) H(x) 4 N(x). (5.11) 


Remark 5.2 If b; = 0, then N(x) = 0. Moreover, if W is a quadratic function, 
then Condition 5.1 can be easily satisfied if there exist a number M > 0 and a 
function Y : R’* — Rso such that | f(x, e)| < Mle| + Y (x). Detailed clarifications 
for Condition 5.1 have been given in the example section. 


Condition 5.2 There exist a positive definite function o : R= — Rso, a function 
ô : R” — Ro and a constant K > 0 such that for all x € R™ and e € R”, the 
following inequalities hold: 


a(x) > o (Cpxp) 
96 (x) 
Ox 


Next, we impose a stability assumption for the x subsystem, which will be used 
to construct a Lyapunov function for the entire closed-loop system by combining 
Assumption 5.1 and the coupling conditions Conditions 5.1 and 5.2. Assumption 
5.2 involves coupling with some of the functions that appear in the two previous 
coupling conditions. 


fix, e) + TTO (V?5)b) < 5(x) + KW (e). 


Assumption 5.2 Suppose that there exist a twice continuously differentiable func- 
tion V : R'* > R, a; € Js (i = 1, 2), a positive definite function ¢ : R>ọ > Rso 
and constants 0 > 0, y > O such that the following conditions hold: 


e oj (|x|) < V(x) x oo(|x|) for all x € R”, 
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e for all x € R™ and e € R”, the following inequality holds 


QV (x) 
Ox 


fixe) + ETOT (W?V)b,) < —e(|(x, e)|) — H?(x) - 0N (x) 


— 6 (x) — 8(x) + y?W(e). 


Remark 5.3 e satisfies e(0) = 0 and e(s) > 0 for s > 0. Assumption 5.2 can be 
satisfied for linear systems if x subsystem is stable. How to compute the parameters 
will be explained in the example section. 


Consider the following scalar differential equation 
: 2 K 
$ — L9 ty ue (5.12) 


with the initial value satisfying $ (0) = p € (0, xi and $ is defined on [0, .7) where 


1 + K rP 
(5 arctan NA 2 , y +— 
Tays Y 2 r2 


y 4y 
1 1 K rP 
sb yd (5.13) 

Yypctn y Ay 

1 +ri)+r K DP 

" A/Y Go +11) M 

2r/Y —4/y(p--n)-ra y 4y 

with ry :— z and ry :— Jly + & — zl. 


The number 7 in (5.13) is such that lim;4 7 $ (s) = oo. For a twice continuously 
differentiable function U, define the following operator 


dU 1 
LU (x) = FD F 5 IG" G0(V*U) BQo). 


We are ready to give the main result of this chapter. 


Theorem 5.1 Consider the system (5.7). Assume Assumptions 5.1 and 5.2 and Con- 
ditions 5.1 and 5.2 hold. Suppose that O < Tmin < Tmax < J and the following 
conditions hold: 

(1) the distribution functions of the random variable vj and v» satisfy (5.10) and 
the following condition 


p 
f o(ur)uatdra) < £, 
(Tmin, Tmax] 
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(2) Y 9 (Tmax) * 0, 
(3) 


0<q< pde J tin, Trax e "u»(dv2) l 
4 Ser T, 1 P (v2) us (dv2) — p 


mins 4 max 


Then the set W :— {0} x {0} x [0, Tmax] is UGASp. 


Remark 5.4 Because Tmin > 0 and the probability outside the set [Tmin, Tmax] is 
zero for the random variable v2 according to Condition (1) of Theorem 5.1, Zeno 
solutions do not happen almost surely. 


Remark 5.5 If N(x) = 0 for all x € R” which often holds for the case without 
stochastic noise in the plant, then condition (2) of Theorem 5.1 can be removed since 
0 can be taken arbitrarily large. 


Remark 5.6 Because $(0) = o < A and p < 2. conditions (1) and (2) of The- 
orem 5.1 can be satisfied for Tmax sufficiently small. Besides, Tmax should satisfy 
Tmax < J to make ¢ well defined. Therefore, Theorem 5.1 allows that the stochastic 
networked control system is stable in probability provided that the detection interval 
is relatively large with low probability and relatively small with high probability. We 
note that in [30], the authors consider similar idea while in the deterministic manner 
for linear systems. The sampling interval can be very large in [30] but the average 
sampling interval is small. 


Proof Construct a function as follows 
U(x) :2 VG) +e *8(x) + yo(t) WE) (5.14) 


where ¢ is the solution of system (5.12). 
Then we can compute for all x € C that 


oV 1 
LU) = fies e) + 5 Tri (V V)bi) 


06 (x) 
Ox 


1 . 
+e Trb] (V7G)bi) + yéc)W() 


ƏW (e) 
de 


te ‘'a(x)+e°% 


Si, e) 


+ y(t) ( falx,e)+ JMOL W) f (5.15) 


Combining Assumption 5.2 and Conditions 5.1 and 5.2, we can derive from (5.15) 
that 
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LU (x) < —e((, D — H?(x) — ON (x) — 8 (x) — 8(x) 
+ y?W(e) +e *6 (x) + d(x) + KW(e) 


K 
-y(-Lé—-y$-y LAO 


+ yo(LW(e) + 2 We) H (x) + N Qo) 
< —e(|(x, e)l) — H?(x) — y?9?W (e) + 2y 9 / W (e) H (x) 


< —e(|@, e)l). 


For x € D, we next discuss three cases. 
Case (I) W (e) < qo (y) 
We can derive for g = G(x, v) that 


/ (Hui UD e eto f sass 
R2 [Tin T, 


min» Tmax] 


T Í $ (v2) ua (dv3) W (e) — a(x) — yo W (e) 


Tmin», Tmax] 


s 6x) (J e ^ w2(dv2) — i) 
[Znin Tmas] 


+ gen) ( Í Jonui- P) 
[Tmin Tmax] 
saed (5.16) 


for some class-.% function £1, where we have used condition 3) of Theorem 5.1, 
B2 Tmin; Tax ]) = l and p(s) >p for s € [Tmin, Tmax]. 

Case (ID W (e) > qo (y) 

For this case, we can derive 


[ Uudo) — UG) = 86) Í 2 UA - Gy 


Tmin» Tmax] 


+f 
[fossi 


min» 4 max 


x —6(x) (1 — { e ua (dug) 
Inin, Tmax] 


—yWe) (; = af (eua dvs)) 
[isch] 
< —ex(lG, e) (5.17) 


£ 
$ (v)u2(dv) X` W (hle, kui (k) 
k=0 


for some class-/£ function £2, where we have used condition (1) of Theorem 5.1, 
Assumption 5.1, “2([Tinin, Tmax]) = 1 and the independence of v; and v2. 
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Case (III) W(e) = qo (y) 
Combining case (I) and case (II), we can also conclude some class-.% function 
£3 such that 


I max U(g)u(dv) — U(x) < —83(x, e)l). (5.18) 
R2 £€G(x.v) 


By applying Corollary 1 of [83], the proof is completed. 
We next present a corollary for the special case of periodic sampling, which means 
P(v—T)-l. 


Corollary 5.1 Consider the system (5.7). Assume Assumptions 5.1 and 5.2 and Con- 
ditions 5.1 and 5.2 hold. Suppose that the stochastic detection reduces to the periodic 
detection with detection period T > 0. Then the set W :— {0} x {0} x [0, Tmax] is 
UGASp if 

(1) the detection period satisfies p(T) < 2s 

(2) yo(T) x 6, 

(3) q satisfies the following inequality 


1— eT 


1 
0 = B! 
34 ye6(T)—p 


5.4 Example Studies 


In this section, we show how to verify the conditions of Theorem 5.1 for linear 
systems and a nonlinear system. 


5.4.1 Linear Systems 


Consider the following linear plant 
dxy = Apxydt + Byudt + Ejyxydw, y = C,xy. 
An observer-based controller is given as follows 
dx, = Apx-dt + Bpudt + Lc(Cpxc — y)dt, u = KeXe. 


Then the closed-loop networked control system can be written in the form of the 
stochastic hybrid system (5.7) with 
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RiQ, e) 2 Anx + Aye, fo(x,e) = Anx 
bi(x,e) = Aiax, bo(x,e) = Aoax 


and 


DE Ap B,K. E 0 
Au E [n Ap EH ByK, + T , An i EN 


E, 
An = —(CpAp CpBpKe), Ais = ( 0 3) 
A» = —C, (E, 0). (5.19) 


Choose a function W (e) :— e? Qe where Q is a positive definite diagonal matrix. 
Assumption 5.1 can be satisfied according to Remark 5.1. 
It is obvious that W is twice continuously differentiable. We can compute that 


9W (e) 
de 


1 T 2, T T aT 
fala, €) + T(t (V?W)b2) = 2e! QAnx +x" ASQAnx 
< 2/W(e)|Q? Anx| + x7 AL, Q Ax. 


Then for the linear case, the inequality (5.11) in Condition 5.1 can be satisfied with 
arbitrarily small L > 0 and 


HQ) 2 Qi Anx|, N(x) = x! A5 QAnx. (5.20) 


Choose o(y) :=l|Cpxp|?. Denote $:— (C, 0). Then o(y) = Ix" ST Sx. Let 
8 (x) := Ix! ST Sx + u|x|?. Then õ is a positive definite function with u > 0. We 
compute that 


00 (x) 


Ox 
= 2IxT ST S(Aux + Ane) + 2x? (Ax + Ape) 


+ Ix! ASST SAi3x + ux! Als Aiax. (5.21) 


1 T (2 
Jis, e) + ^ TOS (Vas) 


Let ó in Condition 5.2 be a quadratic function with 6(x) :— d|x|*, then we can find 
K > Oandd > Osuch that Condition 5.2 holds by solving the following linear matrix 
inequality 


—d + 6; ®, 
( ol Ni <0 (5.22) 


with 
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$; = 1S7 SAu -IALSTS + u An + WAl, -IALSTSAqu + WAZA 
©) = 157 $AnQ^* + pAn?. 
Choose V (x) := xT Px. Then we can compute that 


QV (x) 
Ox 


1 
fix, e) + 5 Irt (V V)bi) = 2x" P(Aux + Ave) + x" Aĵ P Aiax. 
(5.23) 
Define e(|(x, e)|) := e* |x|? + e*]e?. With N(x), H(x), d(x) and G(x) at hand, 
Assumption 5.2 can be transformed into solving the following linear matrix inequality 


with a matrix variable P > 0 and a scalar variable y > 0 by choosing the parameters 
e* > 0, u 0,1» 0and0 > 0 in prior 


V PAO? 
LT 2 1 <0 
Q^ AL,P —y?I + e* Q7 


where 


V = PA, +AT P  ALPAi + (e* +d + wl + Ad, QA21 + 045,043 + LST S. 


With the above observations at hand, Assumption 5.2 can be satisfied for linear 
systems provided that PA;; + Aj; P + A{3;PA13 < 0 and the parameters can be 
chosen by solving linear matrix inequalities. 


5.4.2 Nonlinear Systems 


Consider the following system 


dx; = (x? — T + x5 + uj)dt + O.1xqidw 
dx, = p — I +x, c u)dt 4-0.1xodw 


with output y = (x1, x2). Assume that there are two nodes in the network with 
yı = x1 and y2 = x», and the probability distribution functions for the two node are 
i41 (1) = 0.45 and 44 (2) = 0.55. Consider the controller u; = —231, u2 = —2y5. 
Then the closed-loop system can also be written into the form of system (5.7). The 
flow dynamics of (x, e) can be written as 
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dx, = (—2x +x? — xi + x3 — 2eydt + 0.1xidw 
dx, = (—2xX2 + a — x3 + x, — 2e3)dt + 0O.1xodw 
de, = (2x, — x2 + x? — xp + 2e, )dt — 0.1xıdw 
de, = (2x4 — x? + xj — xı + 2e3)dt — 0.1xodw. 


Choose W (e) := eT e. It is easy to get A = 0.55, L = 4, N(x) = 0.02x2 + 0.0247 
and 


H(x) = y Oxi — x? x) — x2)? Q3 — 23 +3 x. 


Choose the candidate Lyapunov function for x subsystem as V(x) := 2x2 + 2x2 + 
ix] + ixi . It holds by calculation that 


QV (x) 
Ox 


1 
fix, e) + ZTr(bT (V? V)bi) < —1.5x2 — 1.5x2 — 0.15x1 — 0.15x1 
2 1 1 2 1 2 


+ 36e? + 36e5 — H’ (x). 


Set 6 (x) = o (x) = 0.2|x|?. We obtain (x) = 0.3|x|? and K = 0.4. We thus take 
0 = 30 and p = V0.55. Assume Tmin = 0.001, Tmax = 1 and the detection period is 
subject to the truncated normal distribution over [Tinin, Tmax]. Then the probability 
dense function of v» satisfies 


p2(v2) = v2 [Tinins Tmax] 


9 ua) m 9 uis) ' 
and po(v2) = O for vz € R — [Tmin, Tmax] where ¢ is the cumulative distributed func- 
tion of a normal distribution with mean a and variance b, and is given as follows 


í 1 (s-a)? 
t) :— —— e mw ds. 
d ) f. /21tb 


Set a = 0.01 and b = 0.025. We compute q < 0.0093 by Theorem 5.1. We run a 
simulation for 25s. A typical sample path of the state is plotted in Fig. 5.1. The 
detecting instants and detecting intervals generated by the timer are plotted in Fig. 
5.2. There are 1009 detecting instants. The transmission instants and transmission 
intervals are plotted in Fig. 5.3. There are 807 transmissions among 25s and the 
average transmission interval is 0.031s. There are 371 transmissions for the first 
node and 436 transmissions for the second node. The simulation result illustrates 
the effectiveness of the proposed theorem. Besides, it can be seen from Fig. 5.2 that 
the largest detecting interval is about 0.1s while we compute by Corollary 5.1 that 
the detecting period is 0.0356s for periodic detecting. This shows that the stochastic 
detecting interval has a high likelihood of short time and low likelihood of long time. 
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Fig. 5.1 State trajectories 2.5 r 


state 
o 


time 


Fig. 5.2 Detecting instants 0.12 r r 
and detecting intervals 


generated by the timer 01. J 


detecting instants and intervals 


Fig. 5.3 Transmission 0.18 r r r r 
instants and transmission 
intervals 


transmission instants and intervals 
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5.5 Conclusions 


The stability problem of the event-triggered control is considered for nonlinear sys- 
tems with stochastic dynamics, transmission times and protocols in this chapter. 
The triggering condition is checked at stochastically distributed discrete instants. To 
analyze stability, the closed-loop system is modeled as a stochastic hybrid system. 
Stability conditions are derived by constructing a Lyapunov function. 


Part II 
Distributed Optimization with Network 
Communication 


Chapter 6 A) 
Stability Analysis of Distributed Convex crest 
Optimization Under Persistent Attacks 


6.1 Introduction 


In this chapter, we explore the influence of potential attacks on the ability of an 
algorithm to identify the optimal solution of distributed unconstrained optimization 
problems and the considered attacks change only the communication topology. To 
study this problem, we model the distributed algorithm proposed in [37] as a switched 
algorithm. This algorithm is stable in the absence of attacks and it may be unstable in 
the presence of attacks. When attacks occur, we allow attackers to be able to switch 
topologies at will, until the attacks are shut down and normal operation resumes. 
That is, the topology has arbitrary time-varying edges when attackers are affecting 
the network. Some work has been done on the problem of distributed optimization 
under time-varying graphs by using discrete-time algorithms (see, for example, [61— 
63]). In [62], a discrete-time broadcast-based algorithm is developed to steer every 
node to an optimal value under an assumption of uniformly strongly connected graph 
sequence. In this chapter, we consider a continuous-time algorithm and establish an 
exponential convergence rate by combining hybrid system theory and Lyapunov 
function approaches. A differential inclusion is used to model attack modes (unsta- 
ble modes). Differential inclusions can model arbitrary switching without having to 
specify the switching signal a priori. To guarantee exponential convergence to the 
optimal solution, we use an average dwell-time automaton and time-ratio monitor to 
constrain attacks. Some work related to average dwell-time automata and time-ratio 
constraints has been reported. For example, the paper [32] introduced an average 
dwell-time constraint to analyze stability for switched systems with stable subsys- 
tems. The paper [55] introduced time-ratio constraints to obtain input/output-to-state 
stability for switched nonlinear systems with stable and unstable subsystems. Work 
[8] used an average dwell-time automaton to cast switched systems with this type 
of constraint as a hybrid system. Following these contributions, some work has been 
done in other similar contexts (see, for example, [67, 89, 97]). The average dwell- 
time automaton is used to limit the frequency of attacks. The time-ratio constraint is 
used to limit the relative duration of the attacks. The frequency and relative duration 
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of the attacks impact the ability of the algorithm to identify the optimal solution. In 
this chapter, we explore how large the frequency and relative duration can be while 
still guaranteeing convergence to the optimal solution. 


6.2 Knowledge About Graph 


Consider a weighted graph ¥ :— (VY, &) consisting of a finite vertex set V :— 
(1,2, ..., N} and an edge set &. .% :— {j : (j,i) € £} denotes the neighbors of 
vertex i. If agent i can obtain information from agent j, then (j,i) € & and agent 
j € KK. A path of graph 4 is a sequence of distinct agents in Y such that any con- 
secutive agents in the sequence correspond to an edge of graph Y. If there is a path 
between any two vertices of a graph 4, then the graph is connected. 

æA :— [aij] € RY*™ is a weighted adjacency matrix of 4 with a;; :— lif j € M 
and aj; := 0, otherwise. Define the degree matrix D :— diag(di,..., dy} € R®*", 


N 
where d; :— Y: aij fori = 1,..., N, and L :— D — æ is the Laplacian matrix of 4. 
j=1 

Fora oneni undirected graph, the Laplacian matrix has a simple zero eigenvalue 
with the corresponding eigenvector space {æ1y|œ € R}, and Liy = dn = 0y, 
while all other eigenvalues are positive, that is 0 < Ao < --- < Ày. 

Next some knowledge related to convex analysis is introduced. 

A function f : IR" — R is said to be convex if 


f(ax--(1—a)y) x af (x)--(1—a) f y), Vx, y €eR", Va €[0, 1]. 


The gradient function V f : IR" — IR" is said to be Lipschitz continuous with con- 
stant £ > O if 


IV fà) - Vf)I s £x — yl, Yx, y ER”. (6.1) 
A differentiable function f;, i € N is strongly convex with constant k; > 0 on R” if 


VES — V fio)" « — y) z Kila — y, Yx, y € R”. (6.2) 


6.3 Problem Formulation 


Consider a network of N agents with interaction topology described by an undirected 
graph 4. Each agent i is equipped with a local objective function f; : IR" — IR, which 
is privately observed and known only by agent i. The following assumption is needed 
throughout this chapter. 
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Assumption 6.1 The local objective functions f; : R” — R, i € N are continu- 
ously differentiable, strongly convex with constants x; > 0, and the gradient V f; of 
each f; is Lipschitz continuous with constant £; 0. 


Our objective is to find a distributed algorithm such that agents solve 


min g(x) = x fio» (6.3) 


using only their own local data and exchanged information with their neighbors. 
In order to solve this problem, like in [20], we create an equivalent optimization 
problem that involves N copies of the variable x and a constraint, expressed in 
terms of the Laplacian matrix, that forces all of these copies to be the same. In 
particular, letting x; € IR", denote the ith copy of x, X :— col(xi, ..., xy) € R^”, 
and Lo := L Q I, € R'"*N". where L e RF*" is the Laplacian matrix of 4, we 
consider the following optimization problem: 


min f(X) = 3 fia, 
subject to T = Oyn. (6.4) 


According to [20, Lemma 3.1], we have that the problem (6.3) on R” is equivalent to 
the problem (6.4) on R^” . Also, from [20] we know that the constrained optimization 
problem (6.4) is feasible under Assumption 6.1, i.e., the minimum is achieved for 
some X. The local objective function f; is the private data for agent i, which is 
not shared with other agents. This makes (6.4) a distributed optimization problem. 
Therefore, the task for all agents is to cooperatively achieve consensus with the 
minimum global cost f to solve problem (6.3). 

In the ideal case, communication channels can transmit their information success- 
fully and the optimal solution can be found easily (see, for example, [37, 42, 78, 
108] and references cited therein). In practice, however, making all communication 
networks connected or secure is impossible since the existence of networked attacks 
may lead to communication failures (see [91]). If communication topologies break 
down, the behavior of an algorithm may be influenced. Therefore, it is necessary to 
analyze the influence on the ability of an algorithm to identify the optimal solution 
under persistent attacks. Here we use the set 2 C Zio to denote the types of possible 
persistent attacks and {0} to denote that the topology does not encounter any attack. 

Different types of attacks may destroy different edges of the communication 
network and cause instability of the optimization algorithms. To analyze the effect 
of attacks on the ability of an algorithm to identify the optimal solution, we model 
the algorithm proposed in [37] as a switched algorithm: 
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ti =- V fia Y (aps — xj) — zi 


je 
& = (aps — xj), ZEA, (6.5) 
je 
where z; € R” is the auxiliary variable with initial value z; (0), Z :— col(zi, ..., zw), 


ZeA:—(ZemNi| p Zi = 0,). It can be shown that A is forward invari- 
ant. (aij)o € (0, 1}, and o : [to, +00) — # is a piecewise constant function with 
P := {0} U 2. For each agent i € VY, the algorithm is starting from x;(0), z;(0) € 
IR" with Dh zi (0) = 0,,. Denote V f(X) := col (V fi(x1),..., V fy (xn)) € RP", 
Lo := Lo Q I, € RY”*N™ where L, denote the Laplacian matrices of topologies. 
When there does not exist any kind of attack (or o = 0), we can rewrite the algorithm 
(6.5) in a Kronecker product form: 


jj = Fo(n), (6.6) 


Vf(X)-LoX -Z 
LoX 

there does not exist any kind of attacks and the communication topology is still 

connected. 

In this chapter, we mainly consider the scenarios where we allow attacker(s) to 
be able to switch topologies at will, until the attack(s) is (are) shut down and normal 
operation resumes. So it is convenient to model attack mode with a differential 
inclusion: 


where 7 :— col(X, Z), Fo(n) = i Here Lo means that 


ù e con ) Fen), (6.7) 


ce 


-V f(X)-L,X -Z 


where F, (n) = | L.X 


| .Lo and L, have zero-sum rows and zero- 


sum columns. 

When the dynamics evolve according to (6.6) we say that the graph is in “good 
operation". When the dynamics evolve according to (6.7) we say that the graph is 
in “compromised operation". To find the optimal solution, an attack should neither 
occur too frequently nor last too long. 

For simplicity, for any t > tı > 0, in time interval [t;, t2), let T (t2, tı) denote the 
total activation time of compromised operation and N (f, t;) denote the number of 
switches between “good operation" and “compromised operation". 


Assumption 6.2 There exist numbers p € [0, 1), 6 € Rao, No € Zoo and Tọ € Ryo 
such that, for each t» > tı > 0, T (th, tı) satisfies the time-ratio constraint: 


T(t5,1j) € To + plt — ti), (6.8) 


and N (fo, tı) satisfies the average dwell-time constraint: 
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N(t5,1j) € No + 6(t5 — ti). (6.9) 


Note that when o = 0, work [37] has shown that the equilibrium point col (x7, z7) 
of (6.5) yields the optimal solution of problem (6.4). However, under networked 
attacks, the solutions of problem (6.3) may not achieve consensus since the graph 
may be unconnected and zero eigenvalue of Laplacian matrix may not be simple. 
This implies that the solution obtained under attacks may not be the optimal solution 
of problem (6.3). Moreover, the proposed approach may be used to deal with time- 
varying communications, such as those arising in a mobile sensor network where the 
links among nodes will come and go. In particular, disappearing links may be thought 
of as being like attacks. Also, our approach may be used to imitate controller/actuator 
failure cases. 


6.4 Stability Analysis of the Algorithm Under Attacks 


To easily explore convergence to the optimal solution under such attacks, we first 
make a coordinate transformation and give two lemmas. Then based on these lemmas, 
the main result will be presented. 

Let (X*, Z^) be the equilibrium of (6.6). Define the following variables 


—Z*, g:-[rRYZ (6.10) 


with x :— col(xi, xo) € RN", ç := col(gi, c2) € RN", 7 :=F @ Im, R := R Q Im, 


where x1, cj € R”, x5, c; € RWDM f$ = NR = 0, ÊT R = Iy and RRT = 


Iy — um. After a simple calculation, we have [r R]x — Y and[r R]g — Z.Here 
A(X) :2 V f(X) — V f (X5). (6.11) 
Then it follows from (6.6), (6.7), (6.10) and (6.11) that, when o — 0, we have 
$ = FQ), (6.12) 
where & := col(X1, X2, ¢2) and 
= ny deus X*) 
Fo(&) := | —R Ax + Rx + X*) — R LR X — e; 
R™LoRX2 


When c € 2, we have 
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& econ |) F,(é), (6.13) 


ced 


—rTh(ryi + Rx + X*) 
where F,(£) := | —R7A(rx1 + Rx + X*) — RTL; Ryo — c 
R™L,Rx2 
To show that the optimal solution of (6.3) can be achieved exponentially when 
there are no attacks affecting the network, we consider the Lyapunov function can- 
didate: 


Vo(E) := E7 PiE (6.14) 
2 In 0 0 

where P, := * 5 IN Dm 5luN- Um with o, e > 0, J := (RTLo9R)!, E := 
EJ 
* * = 


diag{d,, ET dy] & In > 0. 


Lemma 6.1 Suppose Assumption 6.1 holds. Then, there exist numbers a, € > 0, and 
matrix & > 0 such that P, > 0 and 


(VVo(&), Fo(&)) € —41Vo) (6.15) 
A, 0 0 
hold, where X, := Ani (Q1) Qi:—| * Ad A3 0 with A; :=akly, — 


= Àmax (P1)? e 
* Ck Sl(N-Um 


Im,  A2:— Klim + (a eJ! — E lwm Aa = $J! — 
k := min(kj, ..., Kk y], £ :— max{@),..., £y]. 


E —a luu im 


Proof According to (6.12) and (6.14), we have 


(VVE), Fo(£)) —aY" h(rxi + Ryo + X*) ax] R'LoRxa 
— axi c — eç? 62 - exf R LoRxo + c1 E xa 
— ect R'h(ryi + Ryo + X) — ecl R'LoRyo. 


Since the local objective functions are strongly convex with constant «;, we have 


Y" h(ryy + Rya + X*) «(X — X*) (V F(X) - VFX") 
>Kx" x, (6.16) 


where Y is defined in (6.10) and A(r x1 + Rx» + X*) is defined in (6.11). 
Applying Young's inequality gives that 
E 


€ 
—ecd RTħ(rxı + Rx2 + X*) < 592 oo + 5 X x. (6.17) 
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From (6.14), (6.16)-(6.17), it follows that 


T T pT E 2. T 
(VVE), Fo(6)) < — axx x — (a—&)x; R LoRxot 5 xT x 
E 
- ec; R'LoRjo- 5 


z-& gt. 


53 Q-- X1 G6) — 0X1 € 


m 


For any given o, E > 0, there always exists a small enough constant £ > 0 such that 
Qı > 0. Therefore, we have 


(V VoG), Fo(5)) < —VoG). 


The proof is completed. 
Next, to evaluate the bounds of the solutions of system (6.13) evolving during the 
persistent attacks, we consider the Lyapunov function candidate: 


V É) :—£' bé, pe J, (6.18) 
Ah 0 0 
where P, = * E IN om 5 IN Dm with P. é, 0 > 0. 
* * 2J 


Lemma 6.2 Suppose Assumption 6.1 holds. Then, there exist numbers B,8,0 > 0 
such that Pa > 0 and 


(VVE), F5(5)) < 2V), pe 2 (6.19) 
IT, 0 0 
hold, where ùz := MaXpeg Lue Q»y := * Ih i IT, with 
EE. —51-1)m 
Ili = — pk In + 2s Ih = —BKIw-1)m + eC T(N -1yn (B &)R'L,R, 
Ih := —£ Ii im t ar RTLjR. 


Proof From (6.13) and (6.18), we have 


(VV E), F,()) = — Bxi r arxi + Rx + X*) 
— Bxi R' h(ryi-- Ryo X*)-B x1 R L Ro 
— bxi 62 +063 JRL RX — E53 e 
+ €xz R'L,Ryz-6c; RIX + Rx + X*) 
— čs? RTL)» R% 
<|O2p|é7E. (6.20) 
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Then, it follows from (6.18) and (6.20) that 


(VV, G), F,(5)) < 45V, (5). 


The proof is completed. 
Before presenting the main result, we first give the definition of exponential con- 
vergence for switched systems. 


Definition 6.1 Theequilibrium of the switched system (6.5) under a class of switch- 
ing signals S is said to be exponentially stable with rate of convergence c > O if there 
exists M > 0 such that, for any switching signal o € S and any corresponding solu- 
tion €, we have 


I§(t)| < M|&()| exp(—ct), Vr > 0. 


We now give the main result. 


Theorem 6.1 Suppose Assumption 6.1 holds. Choose parameters a, £, p, £,0 > 0 
and matrix & > 0 such that the conclusions of Lemmas 1 and 2 hold. Let X1 and X5 
come from those lemmas and suppose 5 > 0 and p € [0, 1) satisfy 


(1 — o)À, — par — ôln(u) > 0 (6.21) 
with u :— max [max cA , IDaXgrg-i LE | 


Under these conditions, for the switched system (6.5) under the class of switching 
signals satisfying Assumption 6.2 with this ô and p, the optimal solution x* of problem 
(6.3) is exponentially stable with rate of convergence 5, where X :— A1 — y and 


2? 
y := ôln(u) + pQa + Aa). 


Remark 6.3 In (6.21), (1 — 0)4, is used to measure the average rate of exponential 
decay of the stable Lyapunov functions due to the stable subsystems, while oA» is 
used to measure their exponential growth due to the unstable subsystems and à ln (u) 
is used to measure their exponential growth due to the switches. 


6.5 Stability Analysis 


To show the convergence to the optimal solution of problem (6.3), we construct a 
hybrid system whose state consists of the state of the switched system, a switching 
signal p, and two auxiliary timers tı and t2. The dynamics of the timers tı and 
t; are specifically designed to not only incorporate the effect of the average dwell- 
time constraint and time-ratio monitor, but also to be used to construct a Lyapunov 
function for the hybrid system. 
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6.5.1 A Construction of Hybrid System 


To restrict the frequency of attacks, we introduce an automaton with auxiliary state 
7; € Ro, which is described by 


îi €[0, ô], T| € [0, Nol, 
rf =r — 1, nell No], (6.22) 


where ô € Ryo and No € Zo. In [8, Proposition 1.1], it has been proved that this 
automaton is able to generate each hybrid time domain E that satisfies the average 
dwell-time constraint 


N(t,s):= j—i < No 9(t — s), V(s,i), (t, j) € E, (s, i) < (t, j), (6.23) 


and for each hybrid time domain satisfying (6.23) there exists a solution of (6.22), 
having the said hybrid time domain (also see [32, 56—58]). 

Recall that T (t, s) denotes the total activation time of unstable modes p € 2 
between times s and f, and T (t, s) satisfies the bound in (6.8). From [97] we know 
that this kind of time-ratio constraint can be induced by a time-ratio monitor with an 
auxiliary state t2 € IR. o, which is described by 


t € [0, o] — I2(p). v2 € IO, To], (6.24) 
where 


l pe 


0, otherwise. 


Lo(p):— (6.25) 


In [67, Lemma 7], it has been proved that this monitor is able to generate each hybrid 
time domain E and signal p : E — that satisfy the time-ratio constraint 


re sy- f Io(ptr, i@))dr < To+o(t — s), (s,i), (t, j) € E, (s,i) < (t, j), 
(6.26) 


and for each hybrid time domain satisfying (6.26) there exists a solution of (6.24), 
having the said hybrid time domain. 

Combining (6.22) and (6.24), we generalize (6.12) and (6.13) to a hybrid system 
with the state variable ¢ := (&, p, T1, T2): 


t eF), cec, 
t* eG(t), t€ D, (6.27) 
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where 
Fol) 
{0} 
(0, 8] i ¢ € Cj 
u [0, o] 
FO Mont s FE) 
(0j 
[0, 8] , ¢ € C2, 
[0,0] — 1 
E 
P 
ca 
j= 
T2, 


C; := REND x {0} x [0, No] x [0, To], 
C; := RON-D™m x 2 x [0, No] x [0, Tol, 
C := C1 UC), 

D := RON-U" x P x (1, No] x [0, To]. 


6.5.2 An Explicit Lyapunov Function Proof of Convergence 


Choose the following Lyapunov function for system (6.27): 
Vo) := Vp (€) exp(In(u)vi + (Ai + 22)72), (6.28) 


where V,, p € P are from (6.14) and (6.18). 
According to (6.21) and the definitions of A, y in Theorem 6.1, we have à > 0. 
For all ¢ € C, from Lemmas 1, 2 and (6.25), it holds that 


(a) if p € {0}, 


9V(£) aVeé, P, T1, T2) ave, P, T T) OVE, P, Ti, T2) 


"e F(¢) sae Fol) m an 
€(—2A + db In(w) + (Ai A3)V (¢) 
<—-AV(); (6.29) 


(ii) if p € Q, similarly, we have 
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ƏV (g) 


ae F(£) S(A2 + 6 In(u) + G4 + 23)(o — D)VG) 


SAV (G): (6.30) 


From y given in Theorem 6.1, we obtain 


VG) € UVE), p.a e P. (6.31) 
For all z € D andall ¢* € G(C), it follows from (6.27) and (6.31) that 
V+) =Vp+(E*) expün(g)t; + (A1 + Aa) Ty) 


xpi Vy (E) expln(u)ti + (Aq + Az) tT — In(w)) 
=V (0). (6.32) 


Combining (6.29)-(6.32), we obtain 
V(£(t, j)) < exp(—At)V (2(0, 0), W(t, j) € dom(£). (6.33) 
From (6.14), (6.18) and (6.28), it follows that 


eilzly € VE) < alg ley exp), (6.34) 


where a := minie(2) Amin(P;), 06 :— maxie(12] Amax(P;), W := {0} x F x 
[0, No] x [0, To], D" :— Noln(u) + (Ai + à2)To. 

From the set C U D we have |¢ |w = ||. Then we conclude the solution of the 
switched system satisfies 


eo < 2a exp ( 2) lE (0). (6.35) 
Q1 2 


So for each solution of the switched system with average dwell-time constraint and 
time-ratio constraint, there always exists a complete solution of hybrid system (6.27) 
corresponding to the solution of the switched system. Then from (6.35), we have the 
optimal solution x* of (6.3) is exponentially stable for algorithm (6.5). The proof is 
completed. 


6.6 Example 


Theorem 6.1 provides constraints on the frequency and duration of persistent attacks 
that guarantee convergence to the optimal solution of the problem (6.3). The larger 
these parameters are, the more active the attackers are allowed to be. It typically 
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turns out that allowing a higher frequency for attacks is compatible with allowing 
smaller time ratios for attacks and vice versa. In this section, we explore a tradeoff 
between these parameters in the context of an example by exploiting the freedom in 
the choice of Lyapunov function. 

In order to show how algorithm (6.5) achieves the optimal solution for the 
dynamical network when allowing networked attacks to occur, we consider the 
optimization problem (6.3) with 


fi@=09%41" f@)=@-4” 

B(x) = 0.5x? — 1 fax) = 0.6x? + x 

fs(x) = (x +2)? fo(x) = 0.8x? 4+ 2 

fi) = (x — 10)? fs(x) = a, nib: ers) + 0.9x? 
foxy)=sne+ > fio) = Je 96x. 


By calculation, we can obtain that « = 1, £ = 2. To solve this problem distributively, 
we assign each local objective function to each agent i. The original communication 
topology and the destroyed topologies by attacks are depicted in Fig. 6.1. 

From Theorem 6.1, we must have that p < ô :— aD. Here for each ô, we 
search for o to obtain the maximum allowed p by fixing P, and picking P» to 
minimize A». Choose æ = 4.46,¢ = 1.81, Æ = diag(4.6, 4.6, 8, 8, 8, 8, 10, 10, 10}, 
B =0:0.1: 80, 8 =0: 0.05 : 40 and 6 = 0: 0.4375 : 350 and then the stability 
region is shown in Fig. 6.2. 

We give one type of switching signal which is shown in Fig. 6.3 and this signal 
satisfies the average dwell-time and time-ratio constraints with No = 3, ô = 0.0106, 
To = 0.5, p = 0.004. For simplicity, in dash line of Fig. 6.3, ‘0’ means there does 


beri Sed need 


Fig. 6.1 The left is the original communication topology and the others are destroyed communi- 
cation topologies by two types of attacks 


Fig. 6.2 The stability region 0.012 

derived using Theorem 6.1 TA 
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— (1,0) — c(t2) 
—s4(Li) — 74,3) 


Fig. 6.3 Switching signal o and combined timer v 
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Fig.6.4 The left two pictures denote the optimality condition and optimal solution without attacks. 
The right two pictures denote the optimality condition and optimal solution under attacks 


not exist attacks and ‘-1’ means attacks happened. According to (6.22) and (6.24), 
we plot the behavior of the combined timer t :— In(j)t; + (A, + 42) in Fig. 6.3. 
We see that r decreases when attacks happen and jumps down when a switch occurs. 
Also, we see that it increases when there is no attack. Moreover, the simulation results 
are shown in Figs. 6.4 and 6.5. From Fig. 6.4, we can see that the solution under 
constrained attacks can converge to the optimal point (x* = xf =x} = +- = x] = 
1.2773) which is the same as the optimal point generated without attacks and the 
corresponding optimal value is g(x*) — 109.5. From Fig. 6.5 we observe that the 
optimal solution is exponentially convergent. 
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Fig. 6.5 The logarithmic 6 
curve of the error between 
the cost function and the 4 
optimal value under attacks p 
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6.7 Conclusions 


We have studied the effect of attacks on the ability of an algorithm to identify the 
optimal solution of a distributed optimization problem. To analyze this problem, we 
first modeled an algorithm as a switched algorithm and used differential inclusions 
to model attack modes. Then, to show exponential stability of the optimal solution, 
we modeled the switched algorithm as a hybrid dynamical system using the average 
dwell-time automaton and time-ratio monitor to constrain attacks, and thereby an 
explicit Lyapunov function is given. 


Chapter 7 A) 
Distributed Robust Nash Equilibrium get 
Seeking for Aggregative Games Under 
Persistent Attacks 


7.1 Introduction 


We explore robust distributed Nash equilibrium (NE) seeking for an aggregative 
game in which players have double-integrator dynamics and are influenced by the 
coexistence of unknown time-varying disturbances and unmodeled terms, and also 
are influenced by persistent attacks. Recently, some results on robust NE seeking 
have been obtained in [69, 98, 99]. However, these papers did not consider the effect 
of attacks on the communication topology. Persistent attacks may make the topology 
time varying and even unconnected during some time intervals (see [90, 101]). The 
authors in [90, 101] did not consider the effect of unknown terms on the convergence 
of the distributed algorithms. The unmodeled terms may create coupling among 
the players’ dynamics and this makes the problem more challenging. Moreover, 
the disturbances and unmodeled dynamics may have devastating influences on the 
performance of the system. 

To address the considered games, we regard unknown disturbances and unmodeled 
terms as an extended state. In addition, a reference signal is introduced to observe the 
integrator states and the corresponding error is used to design an estimator to estimate 
the unknown extended state. To obtain the aggregate of the decisions of all players, a 
distributed average consensus scheme is used while considering attacks on the com- 
munication topology. A differential inclusion is used to model attack modes (unstable 
modes). Furthermore, inspired by [22, 90], we model the closed-loop system as a 
hybrid system using an average dwell-time (ADT) automaton and a time-ratio mon- 
itor to model constraints on the frequency and duration of the attacks. Some work 
related to ADT automata and time-ratio constraints has been reported. For instance, 
the paper [32] proposed an ADT constraint to analyze stability for switched systems. 
The work [58] developed optimization-based methods for automatically verifying 
ADT properties of hybrid systems. The work [67] modeled switched systems as a 
hybrid system using an ADT automaton. Following these contributions, some results 
related to ADT automata or/and time-ratio constraints have been obtained in other 
similar contexts [8, 55—57, 78, 89, 90, 97]. 


€ The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2023 95 
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The main content of this chapter can be summarized as follows. First, for the 
unmodeled term, we need only the first-order derivative to be bounded, which is 
relaxed in comparison to [98]. Secondly, we assume the gradients of the cost func- 
tions are locally Lipschitz continuous, which is different from the global Lipschitz 
assumption on gradients used in [11, 69]. In addition, our aggregation function can 
be nonlinear and the cost functions can be non-quadratic, which is a more general 
setting than that considered in [11, 65, 102]. Thirdly, in the proposed distributed 
algorithm we consider the influence of persistent attacks on convergence to the NE. 
This is different from [11, 69, 70, 98-100, 102, 103], justto name a few, in which itis 
assumed that the communication topology is always connected. Moreover, to further 
analyze stability, the closed-loop system is modeled as a hybrid system. Then, a Lya- 
punov function is constructed and uniform (or uniform global) asymptotic stability 
is obtained. 


7.2 Problem Formulation and Model Description 


7.2.1 Game Formulation 


We consider an aggregative game with N players and the communication topology 
among players is described by an undirected graph 4 with the node set 7. Each 
player i € Y aims to minimize its cost function J; : R” — R, whose values are 
written as J; (x;, x .;), where x_; := col(xi, ..., Xi zi, Xi41,---, Xy), by choosing a 
decision variable x;. In addition, J; (x, x .;) is not known by other players j(j Z i). 
In general, player i faces the following optimization problem: 


min Ji (Xi, X). (7.1) 
x; eR" 


The following assumption is needed in the game. 


Assumption 7.1 The cost function x — J;(x;, x ;), i € Y is continuously differ- 
entiable. 


We stack together the gradients of all cost functions to define the map Fy : RN” > 
R^” as 


F(x) := col(V,, J1Ga, x21)... Vey JN (ON, X-N))- (7.2) 


Assumption 7.2. Fy : R^” — R^” is strongly monotone with constant m p > 0 in 
the following sense 


(Fy) — Fv(y)' x — y) > mpix — y, Vx, y e RM". 


The NE of this game is defined as follows (see also [16, 60, 100]). 
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Definition 7.1 A strategy profile x* := col(xj, ..., xy) is said to be a NE of the 
game (7.1) if 


Ji (x7, x*i) < Ji(xi, xt Vx; eR", i e Y. 
The NE of this game satisfies the following lemma (see [15] or [11]). 


Lemma 7.1 Under Assumptions 7.1 and 7.2, x* := col(xp, ..., xy) is a unique NE 
of the game (7.1) if and only if 


VsJiQ?,x* 20, ie Y. 


The aggregation function of the game is o (x) :— x pm gi (xj), where the con- 


tinuously differentiable functions g; : R” > R",i € (1,..., N}, constitute the local 
contribution to the aggregate and x :— col(x;, ..., xy) is the strategy profile of the 
game. 


In addition, the following assumptions are also needed. 


Assumption 7.3 The aggregation function x +> o (x) specifies the gradients of cost 
functions as Vx, Ji (xi, x ;) = GY (xi, o (x)) for functions GY : R” x R” > R^,i € 


v. 


Assumption 7.4 For any compact sets W; C IR" and W2 C R” there exists a con- 
stant £ > 0 such that 


IG? (xi, si) — GY (xi, 5;)| < £|s; — Sil, Vx; € Wi, s;, 5; € Wo. 


7.2.2 Physical Model Description 


The dynamics of player i € ¥ are described as follows: 


Xi = Vi 
ù; = ui + di + gi (x), (1.3) 


where x; € R” and v; € R” are the position and velocity states of player i, respec- 
tively, u; is the control input, d; is an unknown time-varying external disturbance and 
gi (x) is the unmodeled term whose explicit expression is also unknown. Moreover, 
the disturbance d; and unmodeled term g; satisfy the following mild assumption. 


Assumption 7.5 The functions g;, d;, i € Y are continuously differentiable, d; is 
Lipschitz continuous, and c;, c2 > 0 are such that |d;(t)| < cı and |d;(t)| < c» for 
almost all f. 
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Remark 7.2 The condition on d; in Assumption 7.5 is also used in [34, 35, 98]. 
The assumption on g; is different from [34, 35, 98] where it is assumed that the 
first-order and second-order derivatives with respect to x of g; are bounded. 


7.2.3 Networked Attack Descriptions 


To obtain the aggregate of the decisions of all players, a distributed average con- 
sensus scheme will be used. The existing distributed algorithms for game problems 
assume that the topology among players is connected (see, for example, [11, 70, 88, 
98] and references therein). Nevertheless, in many practical situations, ensuring that 
the communication network is always connected is impossible since the existence of 
networked attacks may lead to communication failures and may also result in diver- 
gence of the algorithms (see [90] and references therein). Therefore, it is meaningful 
to analyze the robustness of an NE seeking algorithm for an aggregative game to 
persistent attacks on the communication topology. To simplify, the set 2 C Zio is 
used to denote the types of possible persistent attacks and (0) means that the topology 
does not encounter any attack. 

Inspired by [90], for a distributed algorithm to succeed in finding a NE, an attack 
should neither occur too frequently nor last too long. A hybrid systems approach 
to the analysis of switching systems is useful when only switching signals from 
certain classes are allowed and the frequency of switching is limited. To limit how 
many attacks occur in a given time interval, the following clock state tT; € Ryo is 
introduced: 


tı € [0,6], n € [0, No]. 


ee =T—- 1, TLE [1, No], (7.4) 


where ô € R.o and No € Rs. The above model exactly captures the ADT constraint: 
j —i € No ó(t — s). (7.5) 


That is, every pair of hybrid times (s, i), (t, j) in a hybrid time domain E satisfies 
(7.5) if and only if E is the domain of some solution to (7.4) (see [8, Proposition 1.1] 
for a proof of this fact and also see [32, 56, 57]). 

A hybrid system can be used to model the evolution of learning dynamics under 
persistent communication failures and different adversarial scenarios that may cause 
instability of the closed-loop system. To address this case the compact set Y can 
be partitioned as Y := {0} U 2, where the mode q = 0 characterizes the stable 
dynamics, while the modes q € 2 characterize the unstable dynamics. For such 
systems, good behavior of the solutions can be guaranteed as long as the amount of 
activation time of the unstable modes 2 is bounded by a time-ratio constraint [97], 
which has the following form: 
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To 

T(t,s) S — t p(t — s), (7.6) 
K 


where T(t, s) donotes the total activation time of unstable modes p € 2 between 
times s and t, p € [0, 1), To € Ro and x is from (9). From [97] we know that this 
kind of time-ratio constraint can be induced by a time-ratio monitor with an auxiliary 
state T2 € Rs, which is described by 


tz € [0, ko] — kLo(p), t2 € [0, To], (7.7) 


1, pe2 
where I2 (p) := p , This is to say that a hybrid time domain E 
0, otherwise. 


satisfies (7.6) if and only if E is the domain of some solution to (7.7) (see [67, 
Lemma 7] for a proof of this fact). 


7.3 Distributed Algorithm Design 


We aim at designing the control inputs in (7.3) to achieve robust computation of a 
NE when such an NE exists. Let w; :— d; + g;(x) and 6; :— d; (t), then the dynamics 
of player i with extended states can be written as 


6; € Be, (7.8) 


where w; € R”, 6; € R”, v := col(v;, ..., vy} and c» is given in Assumption 7.5. 

Since different types of attacks may destroy different edges of the communication 
network, a new distributed algorithm based on a switching method is designed as 
follows: 


uj = —Gj (xi, si) — 8; — kv; (7.92) 

V; = ui +O; + (ki + ki)(vi — Vi) (7.9b) 

D; = kiri (vi — V) + Bisgn(v; — i) (7.9c) 

§ = (= (si — ei) — Y, (ai)pGi — 55) — zi) (7.90) 
je 

Zi—k > (aij) psi — Sj), z € A, (7.96) 


JEM 
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where V; € R”, i; € R”, s; e R”, z; e R”, z:=col{z,...,zw}, ze A:— {z€ 
RY” | ae zi = 0}. It can be shown that A is forward invariant. (a;j), € (0, 1} 
and p : [f, +oo) — F is a piecewise constant function. The positive parameters 
k, ki, kj, k are to be determined later. 


Remark 7.3 In this algorithm, v; could be regarded as a reference signal for v; and 
the corresponding error signal is used to obtain an estimation ij; of the unknown 
extended state w;. GY (x;, s;) is as an approximation of gradients for the presented 
game. s; is for the estimation of the aggregative function and z; is as an auxiliary 
variable for ensuring exact estimation. 


Define the following error signals: 


cmd a MER f — * 
Cui t= Vj — Vj, Wi :— Wi — Wi, Xi = Xi — Xj, 


Csi T= Si — Sp. Co T= Zi — Z7, (7.10) 


where xf is the component of the NE for player i, s; :— x yG qi (xi), ZF := 
gi (xi) — sj. 
It follows from (7.10) and the definition of A given in (7.9e) that 


N 
J ea=} Gi -=a - Qix) — sf)) =) 52-0. (7.11) 


i=1 i=l i=l 
From (7.8)-(7.11), we obtain the following system: 
by = —(ki + Kou + Ù; 


Wi = —kikity — Bisgn(Syi) + 6; + gi 
ù; = —kvj — GY (xi +x”, esi +87) + Ù; 


Xi = vi 
6; € B,, 
eji —k(—e;i 5 (aij) p esi esj) — ej) — Vi 
JEN 
ég — k Y Gij)p (esi — esj) — Vai + Wis ez EA, (7.12) 
JEN; 


ak T 
where pe Y, y:—col(xi,.... XN) 8i:— (25922) v, Weis x EU 


, T T 
89; (Xi X7) . o (Ia 0itxD) . "ES 
(( 8 xi--x;) ) w), Wri = ( O(xi +x) ) Ui, ez m col(ezi, NOE ezn} 


The algorithm corresponding to (7.12) is distributed since each player exchanges 
information only with its neighbors, 

Denote £, := col(£ji, ..., Con), W := col(t0,..., Wy), 0 := col(61, ..., Oy), 
es = col (esi, ..., eu), S* t= col(sŤ, ..., SX), 8&:=col(gi,..., 8N) di(x + 
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x*, v) :— col(yi, ..., Vu), a(x t x*, v) = col(/ra,... Wen), ke = diag {ki}, 
Ke := diag{x;}, Be = diag{B;}, L, = Lp Q In, Kp := (ke F Ke) Q Ín, kp: 
(ki) & I, and B; := f. & I,. Then we can rewrite (7.12) in a Kronecker product 
form: 


b = —Kply + w 
Ù = —kit, — Brsgn(t,) +0 +8 


b= —kv — GY (x - x*,e,4-s*) -- Ù 

=v 

) N 

0 E Ba 

es =K( es L,e; ez) $i(x Tas v) 

é; = kLpe, — Q(X +x", v) + di(x +x", v), e; € A. (7.13) 


The right-hand side of system (7.13) is discontinuous. We will use Krasovskii regular- 
ization to transform it into a differential inclusion since this regularization accurately 
predicts the effect of small state perturbations on solutions to a differential equation 
with discontinuous right-hand side (see [24]). Inspired by [24], the work in [22, Chap. 
4] applied this idea to hybrid systems, which are used in the sequel. 

To further obtain the complete closed-loop system, we perform the following 
orthogonal transformation: 


v :=[r R]’'e,, E:= [r R] e; (7.14) 


with 2 := col(9;, 95) € RY”, £ := col (é, &) € RN", r :=F Q In, R := RQ In, 
where 9, £y € R”, ty, & e ROTD™ F := "i r7R=0,R7R= 


N^ 
Iy — rli . After a simple calculation, we have [r R]9 =e, and [r R]é = e;. 


Then, combining (7.13) and (7.14), we have 


n = —Kplby + iU 
Ù € —kit, — BISGN(G) +0 +8 
ù = —kv — GY (x + x*, r9, + RD 4-5*) +0 


6 e BN 

ùi ——k01 — r'o (x t x*, v) 

Ù =k (0 — & — R L RO.) — R' di(x + x*, v) 

& = KRL Rd — R” a(x + x*, v) + R' di (x +x*, v) 

& — 0. (7.15) 
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In (7.15) we have used the constraint e; € A and from this constraint we can obtain 
that €; = 0. Clearly, (7.15) is equivalent to (7.13). Thus, we can analyze stability of 
(7.15) to show stability of (7.13). 

Combining (7.4) and (7.7), we can model (7.15) as a hybrid system with the state 


variable ¢ :— col(v, 8, ti, t», y): 


tCeF() cec 
t eG), ¢€D, (7.16) 


where v := col(Z,, w, v, x, 0), y = col(9,, 95, £2), 


f (v, 94, V2) 
(0j 
[0, ô] , CEC; 
[0, <o] 
k Fo(y, x, v) 
PRO f (v, 94, 02) 
{0} 
[0, ô] , EC, 
[0, xo] — K 


co U «Fp, x, v) 
pe2 


—Kpby + Ù 
—kit, — BıSGN (t) +0 +8 

fo, Hh, 85):2| -kv — GY (x + x*, r0 + RQ +5*) +0], 
v 
BY 
c2 

—91 — tr? bi(x +x*, v) 
Fo(y, x, v) := —0; — & — R LoRd, — LRT ja (y +x*, v) : 

RTLoRO; — RT do(x + x*, v) + t RT dic +2, v) 


—01— Lr jy (x T x*, v) 
Edy X, v) := =v, — & — RTL, Rd — RT fa (x +x*, v) ; 
RTL, Rð — RT j»(y + x*, v) + ERT dax + x*, v) 


G(v, T, Ti, T2, y) = col(v, A \ o}, T> 1, T2, y), (7.17) 
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and 


C, = (RÉM! x BY) x (0) x [0, No] x [0, To] x ROY)", 
C» :— (R^! x BY) x 2 x [0, No] x [0, To] x ROND", 
C:=C, UC, 
D:= RAN” x BY) x A x [1, No] x [0, To] x RON-Dm. 


Note that Y := {0} U 2 while c, is given in Assumption 7.5, and kp, kr, Br, k 
and « are control gains. The auxiliary timers tı and r» are specifically designed to 
incorporate the effect of the ADT constraint and the time-ratio monitor. o is a logic 
variable used to identify whether an attack happens. Here, Lo means there is no 
attack on the network and the communication topology is connected. L, means that 
an attack is happening. Lo and L, both have zero-sum rows and zero-sum columns. 

In next section we will show how to select the gains within the control scheme to 
guarantee convergence to the NE. 


7.4 Stability of the Hybrid Algorithm 


In Sect. 4, we modeled a robust distributed NE seeking algorithm under persistent 
attacks as a hybrid system. In this section, we will give some conditions on the hybrid 
system and the control gains such that the compact set 


W := ({0} x BY) x P x [0, No] x I0, To] x {0}. 


is uniformly asyptotically stable. If this set is uniformly asymptotically stable then, 
from Lemma 7.1, Assumption 7.3, (7.10) and (7.16), we know that the system con- 
sisting of (7.8) and (7.9) converges to the NE of the game (7.1). 

To help deduce stability condition for the algorithm, two lemmas will be given. 
They show, respectively, that the NE can be found when there are no attacks against 
the network, and that bounds on the solutions during the persistent attacks can be 
evaluated. Choose the following Lyapunov function candidates: 


Vo(y) := y? Poy 


E T 
V y) :=y Pry, pe 2, (7.18) 
B m 0 0 5 In 0 0 
where  Py-| x Miwim niwm , Pus x Ylin elt with J:= 
* * d * * Ay 


(RTLoR)^., y; > 0,8 € {0,..., 4}. 
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Lemma 7.4 Suppose Assumption 7.5 holds. There exist constants yo, yy > 0 such 
that Py > 0 and 


(VVo(y), Foy, x. 0)) € —A1Vo(y) + s 


hold for all values of y,x and v, where Xj:— imt Qo := 
Yolm 0 0 i 
* Ay BIT! | > 0, A = plwm — S + (y y)J75, Q1:— 
"D / “tm 
Qvo t 2yi + Pylyllgil + Qa + Plyligal, $1 := dix t x*, v), h := 
$5 (x + x*, v). 


Lemma 7.5 Suppose Assumption 7.5 holds. There exist constants yo, y3, ya > 0 
such that P, > 0 and 


(VV), F, x. v)) < AV) + 2, pe 


"M 1Qipl uu 
hold for all values of y,x and wv, where AXj:— n DRIN Qip:= 
—yoln 0 0 
* By By , E=—y2Twaym — (5 — yo) RT LR, 82 := 
* x —Yyal(N-0m 
atrium TE Yl V lenin R™L,R, 02 := (22 ES 2y3 up #)lyllgıl 4 (y+ 
/:|ylIóg. 
Remark 7.6 We emphasize that the parameters y;, i € {0,..., 4}, do not depend on 


the value of x*. However, the expressions o; and o» in the two lemmas do depend 
on x*. The proofs of Lemmas 7.4 and 7.5 are similar to the proofs of Lemmas 6.1 
and 6.2, so we omit the proofs here. 


Next, we give the main result. 


Theorem 7.7 Suppose Assumptions 7.1—7.5 hold. Choose parameters y; > 0,i € 
(0, ..., 4} such that the conclusions of Lemmas 7.4 and 7.5 hold. Let à; and X» come 
from those lemmas and suppose xK, ô > 0 and p € [0, 1) satisfy 


(1 — p)ài — paz 


oD 2% (7.19) 
K 


T T 
y By y Poy 
"Poy? It y Py 


with u :— max | max 


max + | Then there exist constants k*, B* > 0 
yly=i? 


such that for all k > k* and Bi > B*, the set W is uniformly asymptotically sta- 
ble for the hybrid system (7.16). 


The proof is presented in Sect. 7.5. 
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Remark 7.8 The local stability of a NE can also be found in [16, 103]. The estimate 
of the basin of attraction can be obtained by the constructed Lyapunov function in 
Sect. 7.5. In addition, we use the ADT and time-ratio constrained parameters p 
and 6 to analyze the behavior under attacks. The larger these parameters, the more 
active attackers are allowed to be. To guarantee the convergence to the NE, we use 


inequality (7.19) to constrain these parameters. From Theorem 7.7, we must have that 
ji, Enw : I : 
p< z a For each ô, one can use a grid search method to obtain the maximum 


allowed p by fixing Pp (i.e., yo, yı) and picking Pı (ie., yo, 73, y4) to minimize 
Az. About these parameters, in our previous work [90], we have used a Lyapunov 
function approach to maximize the time-ratio parameter by fixing the ADT parameter 
and then gave a tradeoff curve between parameters p and ô. 


In Theorem 7.7, we assume that the gradients of cost functions of all players are 
locally Lipschitz continuous and the aggregation function is continuously differen- 
tiable, and uniform asymptotic stability is obtained. If we consider the following 
standard Assumptions 7.6 and 7.7 that are used in [11, 65, 98], uniform global 
asymptotic stability can be obtained. 


Assumption 7.6 Si G, Gri, si) is Lipschitz continuous in s;, uniform in x;. 
Assumption 7.7 F is strongly monotone and Lipschitz continuous. 


Assumption 7.8 The functions g;,i € Y are continuously differentiable and x > 


ag; 9g; Qi 
8e. x; > 2992 are bounded. 
x Ox; 


Theorem 7.9 Suppose Assumptions 7.1, 7.3, 7.5 and 7.6—7.8 hold. Choose param- 
eters y; > 0,i € {0,...,4} such that the conclusions of Lemmas 7.4 and 7.5 hold. 
Let X1 and àz come from those lemmas and suppose K, 5 > 0 and p € [0, 1) satisfy 
inequality (7.19). Then there exist constants k*, B* > 0 such that for all k > k* and 
Bi > B*, the set W is uniformly globally asymptotically stable for the hybrid system 
(7.16). 


The proof is a simple adaptation of the proof of Theorem 7.7, and so is omitted. 


7.5 Proofs of the Main Theorems 


Before presenting the proof of Theorem 7.7, we will first give one lemma which 
can be found in [3, 36, 82]. Moreover, some definitions about Clarke’s generalized 
gradient, generalized directional derivative and regular function can be found in [10]. 
Consider the following differential inclusion: 
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x € F(x), (7.20) 


where F : R” — R” is OSC and LB. 
The following lemma can be found in [3, 36, 82]. 


Lemma 7.10 Let x(-) bea solution to (7.20) and V : R" — R be a Lipschitz and in 
addition, regular function. Then t — V (x(t)) is absolutely continuous, SVG (t)) 
exists for almost every t and, where it exists, it satisfies: 


d 
—V(x(t)) < min max p 
dt pedV(x(t)) qeF(x()) 


We now give the proof of Theorem 7.7. 


Proof of Theorem 7.7 Choose the following Lyapunov function: 
Cy 
U) = WO) + ZVO), (7.21) 


where ye := col(G, ti, T2, y), y, v are from (7.16), Vz, © € Z :— {0} U 2 are from 
(7.18), kK, Cy > 0 


V (Ye) = Ve(y) exp(n(u)r; + (Ay + A2)T2) 


N 
1 i er eee M 
Wr) = 5t bo + z 7 QU — atr à E milo 


i=l 


1 kb 
— 6" Qt, + sv v XT x buy v (1.22) 


with Q:—IT Ih, Mi= (ke + €) + In) Q In, IT; | m; = CRRA i ey, 
0 < by < k, and 


(b —1» 
kiki? (ki +i)? 


o? < min | 


J. b>La>0 ie”. (7.23) 


Denote M := diag{m;} & I, and note that x; is from (7.13) and Q, M are diagonal 
matrices. From (7.23), one can derive o (k; + «;) + 1 < b, Vi € VY. Applying the fact 
that cı wr + c20102 + C3 oZ is a positive definite function with respect to c, w2 under 
the conditions i — 4cıc3 < 0 and cj, c3 > 0, we conclude that W (v) = 0 if v = 0 
and W (v) > 0, otherwise, and it is radially unbounded. In addition, yy mj|Cy;| is 


Lipschitz continuous. From Clarke’s generalized gradient and (7.21), we have 
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t, — a + MTSGN (t) — O76 
—at, + QT i 

v + dex 
kby x + bgv 


8U(t) = cO" 


te I ) 
& V; (y) In(u) apia + Qa + Ap)t9) 
a Vy ()04 + Aa) exp(n() mi + Qa + A2)t) 
& 2920 exp(In(u)t; + Qa + A2)02) 


For all ¢ € C, from Lemmas 7.4, 7.5, (7.4), (7.7) and (7.16), it holds that 
(i) if o e {0}, for all ¢ € B; we have 


min max vq < —Z£I kply c a Kyly—SGN(by)' Mk ply th, QT k,0-- CT Ù 
veaU(c) qEF(¢) 


-aÑ i — w Q70 c acl kit, +a) BISGN(C) — ac] 0 
-ati g — © Okto + BQO + 7 Qg — kv! v 

— VT GY (x  x*, r0 + R05 + s*) + T v — bykxTv 

— by x1 GY (y 4 x*, r0 + ROD 4 5") + brO x + bykxT v 


ól 
3E uf def egit] -- Qu mu ) Get Ap VO 


Cy 
ge E exp(In(w)t + (A, + À2)72) 


min max (U^ Mc — V M'à). (7.24) 
ESGN (tu) SESGN (Ey) 


In (7.24), note that (ake +x«)+ IN) 8 I, — Ox; = 0. 
Define A := A, — Sint) — p(A, +A). According to (7.19) and Assumption 7.5, 


we have 


ww 
min max v/g < aw Mk c K 
veàU t) qeFQ) qz b T nt, (| pl iQ pl 


— a|Br| — ac; —|QOlcr)|oo|—(kK — b) vv Iv 
— v! GV (y 4 x*, rd, + R5 + 5*) +" x 
— by XGA +x*, ro ER» 5) -o£4,|v| 


A Cy 
+ Llll] — Ac, VQ) + ys, (7.25) 


pan 2 2 ! .— [8g Qcpx*) 
where £, :— J£, He + £5, with £g, := | atx) | 


A2)To), n :— diag{n;} satisfying 0 < n; < (ki + xj) — a (kiki), Vi € Y. 
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According to (7.2), Lemma 7.1, (7.10) and (7.14), we know A* := GY (x* + 
x*,rüf + RÜÓP Eriga) — 0. Denote Aj := GY (x +.2x*, rd) + RD + 
s*), A := GY (x + x*, Ly Q o (x + x*)). Then it holds 

=x" Ai 2- xl (Ai — 4&2 + Aj — A*) 
=x" (Fy(x + x*)) Fe Qx* + x*))7x (41 — 42), 
=v" A, = w" (Fy (x x) FQ +x) (A — A). (1.26) 


Moreover, from Assumption 7.4 we conclude that for any r > 0, there exist constants 


ts uis. joli >0 such that for all ¢ € B; 


=x" (Ai — Ad) < lle sIxllroi + R95], 
—v" (Ai — 42) < Lie p vlr: + Rd, 
—v (Ay — A*) < Kep lellxl £ < £. (1.27) 


Furthermore, it follows from (7.26), (7.27) and Assumption 7.2 that 


—bex" Ay < — bum gx! x + deLi|x Ili + Rd], 
—v A, <hjvlix| + lvli e + Rd], (1.28) 


where £, := b on and £2 := d wo 
Applying Young's inequality, we have 


bym y T = Oey 
br4ilxllrð + R95| < ax X+ 207 21 + 27 02), 


-2 
- 1 i " k jo. 
a£o|£v||v| < gi nts T ; "m wv < g otz v, 
af gT T i T 
&|v||r21 + R25| € — (9; 91 + 05 02) + —v 
4 af 
bum , £e 
bls rx des ea (7.29) 
E 


where constants bz, ay > 0 can be arbitrarily chosen. 
Then according to (7.25)-(7.29), we have for all ¢ € B; 


1 T a 1 -T ~ bym y T 

< j 

Qum Ue 43-35 n-(y- pw WF 
k uo È b, 
2.545 py ot (Z 4 tm Or + 9282) 

6 bym y af 
bem "m 

— MX Ty bw x — QUU 
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2k ot 
= Soti, |O||@||v| — LL E 5 Sulu 


= (Mkp|—c1lQx,| — a|Bi| —oci—|Qlc2)l£v| 


, k js £g 
SUE i 2 1 _ by)vT v. (7.30) 
3 bym y af 


— Ac, V (Ye) + 


For fixed k;, ki, b, ni, m, lg, £1, 65, ay with b > 1, choose bg, k* > O such that for 
all k > k* and0 < b, < k 


k € 2 
6 


b, > 0, (7.31) 
bemp af 


p^ bt 
kw (kitain)? b -D| g= IG 4 64b 
with Ri > mun E > (ke) ? kg? kitar pf h := max m ke? K(k; Ay and 


then we obtain 
bum oumy T c 
n x x t by. x - QU Ti <0, a(k; +k) +1<b, 
ae " k k ot 
- SU S--LIOIIIvI- vv «0. geet va, 


where Q is from (7.22) and n; is from (7.25). 
For fixed a, by, ki, ki, b, ni, there exists a constant B* > 0 such that for all B; > 6* 


As := ((Mkp| — cil Qe, — odi — oci — leo) > 0, (7.32) 


where £z is defined in (7.13). 
For fixed a y, by, £1, m f, choose c, to be sufficiently large such that 


À af b, T T 
— 26V e) + (— + ——)(94 9, + 95 05) < 0. (7.33) 
2 4 my 


For fixed af, by, Cy, £1, 2, m p, K, there exists a constant k* > 0 such that for all 
k > k* and for all ¢ € B; 


* k É É b 
Puet NN 2. 1. eh, (7.34) 


mm. WV [5 = 
" US i Ox Dar 2 
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Then, from (7.30)-(7.34) and Lemma 7.10, it yields that for all ¢ € B; 


(VU(Zz),F(z2) < min max vq 


vEeðU (E) qEF Ç) 


1 T [94 1 ~T~r bm y T 
< 
< zv Mv G p" 1 * 
k D dE. Ra A 
A v vV c); 
6 Jhm, 2a. 2^" ee geen) 
(7.35) 
(ii) if & € 2, similarly, for all ¢ € B; we have 
WU). FG) « -litw, — C= Date etur 
’ e 9 v n v 2 k 4 X X 
k D CENE NES 
FAVITeT 
6 hs; a Yee 
À 
— —cyV (yo). (7.36) 


4 
Moreover, according to (7.21), there exist functions a1, 0/5; € #6 such that 
a (lElw) < U) < oo; lw). (7.37) 


Thus, it follows from (7.21) and (7.35)-(7.37) that there exists a continuous, positive 
definite function o4 such that for all ¢ € IB; 


(VU), F(2)) S —o4(U (£)). (7.38) 


From u defined in Theorem 7.7 we have V, (y) < AV, (y), p, q € P. Then combining 
(7.17), for all € D and all z^ € G(v, G, ti, t», y), we have for all ¢ € B; 


Ut) = Wt) + Vg) exp(In(u)t] + (Ay + Az) TH) 
x U(6). (7.39) 


Combining (7.38) and (7.39), for any initial value |¢(0,0)|w < az: ogı(F), it 
yields that U(¢(t, j)) < æı(r). Then by (7.37), we have |Z(t, j)|w <r. There- 
fore, it follows that there exists a class-/£/. Z? function B such that, for any initial 
value |¢(0, 0)|w < az; o oi (P), we have |Z(t, j)lw € &(z(0.0)w. 0), W(t j) € 
dom ¢. According to (7.5), we have t > ŁEM, Then it follows that |¢(¢, j)|w < 
Baco, O)lw, max{ 40% | 0p, V(t, j) edom c. Thus, the conclusions of Theorem 
7.7 follow. 
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A Ad. 


Fig.7.1 aistheoriginal communication topology; b and c are destroyed communication topologies 
by two types of attacks 


7.6 Example 


Here we consider a case with non-quadratic cost functions to verify our algorithm. 
Consider a six-player network with communication topology described by Fig. 7.1. 
The cost functions of these six players, respectively, are 


JiQa, x) = x? e — q(o(x))x1 


2 
. X2 X5 
Ja(xa, X22) = sin — + = — q(o(x))xa 


2 2 
J (x3, x3) := In(e 9.5 + e?) + 0.9x2 — q(o (x))xs 
X; 2 
Ig (%4, x4) := — + 0.6x4 — q(o (x))xa 
x? +9 


Js(Xs, x5) := cos xs + 2x2 — q (0o (x))xs 
Je(xe, x) := e?5 + 3x2 — q (0 (x))x6, (7.40) 


where q (o (x)) := qo — a No (x) with o (x) :— x pm e. and qo, a are constants. 

In the simulation, we first choose yo = 10, yı = 2, y2 = 10, ys = 4, y4 = 
25, x = 100 such that the conclusions of Lemmas 7.4 and 7.5 hold, respec- 
tively, and we obtain A, = 0.1007, A, = 0.656, u = 1.0848. Secondly, given 
qo = 200 anda = 0.1, the disturbances d; (t) = t, g; (x) = 2 2 ie x, LEV ke = 
diag{1, 3, 4, 2, 3, 4}, ke = diag{2, 1, 8, 4, 3, 2}, b = 3, = 2, by = 0.06V0.1 
and k = 700 such that (7.31) holds, then we have a = 0.044. Thirdly, choose 
Be = diag(200, 200, 200, 200, 200, 200} such that (7.32) holds, and then choose 
Cy = 80.2 such that (7.33) and (7.34) hold. Finally, correspondingly choose No = 
2,6 = 0.1, To = 0.5, p = 0.12 such that (7.19) in Theorem 7.7 holds. In addition, 
from (7.40) we know some gradients of these cost functions are locally, but not globally, 
Lipschitz continuous. So according to the conclusion in Theorem 7.7, the initial values 
cannot be allowed to be too far from a NE. Here we choose the initial values of these 
six players to be xı (0) = 2, x2(0) = 5, x3(0) = 2, x4(0) = 3, x5(0) = 2, xg(0) = 1. 

One type of switching signal is given in Fig. 7.2. The simulation results are 
shown in Figs. 7.3-7.5. Figure 7.3 shows that the trajectory of x of the proposed 
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Fig. 7.2 Switching signal 


Fig. 7.3 The evolutions of 
strategy profile under the 
proposed algorithm 
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0 f fi f 1 fi 
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distributed algorithm converges to the NE (xf = 4.3, x5 = 18.49, x} = 16.69, x; = 
17.83, x = 13.22, xz = 1.81). Figure 7.4 shows s; = 189.25, i € VY converge to 
the aggregative function. Figure 7.5a illustrates that v; can track the reference signal 
V; at steady state. Figure 7.5b illustrates that the observation errors of the players’ 
unmodeled and disturbance terms tend to zero. 


Fig. 7.4 The evolutions of s 
under the proposed 
algorithm 


Fig. 7.5 a is the evolutions 
of the errors between the 
original signal v; and 
reference signal Ù, i € Y'; b 
is the observation errors of 
the unknown terms 
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7.7 Conclusions and Future Work 


We have studied a robust NE seeking algorithm in aggregative games for double- 
integrator agents subject to unknown terms. The unknown terms are regarded as an 
extended-state and an estimator is designed to estimate such a state. In addition, a ref- 
erence signal is introduced to observe the disturbed state. To obtain the estimation for 
the aggregate of the decisions of all players, we use a distributed average consensus 
algorithm by considering the effect of attacks on the communication topology which 
may be switching and even be unconnected. Moreover, to further analyze the stability 
of such games, we model the complete closed-loop system as a hybrid system using 
the ADT automaton and time-ratio monitor to constrain attacks. Then, a Lyapunov 
function is constructed and an appropriate set corresponding to the NE is shown to 
be uniformly asymptotically stable. Possible future work is how to achieve a global 
result, or at least a semi-global result, when we do not have the global Lipschitz 
assumption on the gradients. 
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